Don't send user removal stuff in group.member_del