Remove a channel if it's empty