Moved update-/remove-group-association to users.

They can be used in multiple places, hence the refactoring.
We don't need to update sites when we delete user in invite.

User doesn't seem to be part of any site configuration, so the extra
call can be removed. This code was added since #133 was resolved.