Notifications is sent when unfollowing a library

Accepting and rejecting a follow both trigger an "accept" notification:

Probably linked to #682 (closed)