Clean up notifications if a user can't see a topic