client: Renew the XLocSet on replica removals.