Fixed #170. When a user accept an invite, group associations removed.