Use load balancer configuration, not load balancer id, in job-based LB removal logic

This is required to support RCv3.
Non-blocking - can happen in future PR - this function seems like it would be useful in the actual worker code too.