Changed to allow clients to be removed

This is done by deleting the clients that match with that process and
then rebuilding it from the party vector being passed.