Do not attempt to remove from load balancer if there are no load balancers
Merge pull request #747 from rackerlabs/fix-delete-server

Do not attempt to remove from load balancer if there are no load balancers