Stop doing lb_type dispatch in delete_server

This should be done after #772, #773. Closes #767.
Right. I originally wanted to write that test case, but then didn't, because `remove_from_load_balancer` adds another layer of indirection that makes it unnecessary.