Checks if someone unfans you.