Contacts are not removed from the sets when removed?