Fix exception during lb cleanup

Prevent error on cleanup when there are no load balancers.