remove the user before checking if the channel is empty.