Fixed Bug: When adding a group to user, we should add the user to the group. Same to remove function.

For Bidirectional ManyToMany relationship, owning side should be
responsible for maintain both sides relationship.