List of users on server/in channel is removed when the server is dropped