Remove a follower from a topic when they unfavourite