shut_it_down now cleans up balancer entries