IdleChannelDetector should remove empty queues, close #676