Remove queues with no players in