Fix trying to remove a null group from as a player's primary group.