When the user has been kicked or banned from a room, remove the room from his recents list