If you try to delete a balancer that isn't there, don't blow up