Fixed #175 and fixed #176; remove user from group and remove user if user declined to invite