spectrum-sim: stop per-channel goroutines, if no active listeners