Add support for RCv3 to remove_from_load_balancer 

This is, next to #772, the other big one. That one should be reviewed first.
True.  So not going to block this PR on that  :)