Make sure that the correct set of servers are removed from map of cached RxClient when server list refresh happens.

Ensures that when server list is refreshed in the load balancer, the set of servers which equals to (oldList - newList) should be removed from the map of cached RxClient. Any server that is not part of oldList should stay in the map.