Moved update-/remove-group-association to users.

They can be used in multiple places, hence the refactoring.
We don't need to update sites when we delete user in invite.

User doesn't seem to be part of any site configuration, so the extra
call can be removed. This code was added since #133 was resolved.
Merge pull request #178 from yeukhon/invite

Small refactoring on invite