Properly resetting unread conversation count on user removal