Tolerate nonexistent fields in groupFields so that removeFields doesn't trigger hassles