Remove the entire set when restoring old values.