Fix balancer blocking on send during shutdown

If the consumer shuts down while the balancer is trying to say Hi to the mainloop, it will block forever.

Not a big deal as it will probably only happen at shutdown, but leaking goroutines is bad.