Fix issue where leaving the last group a user is a member of throws an error
and doesn't update ldap