Repository: EleutherAI/lm-evaluation-harness
Issue: Error when evaluating math.
Root cause: External Dependency Breakage

The log is like:
```
2024-05-10:13:52:18,741 INFO     [main.py:254] Verbosity set to INFO
2024-05-10:13:52:30,284 INFO     [main.py:341] Selected Tasks: ['hendrycks_math']
2024-05-10:13:52:30,286 INFO     [evaluator.py:141] Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234
2024-05-10:13:52:30,286 INFO     [evaluator.py:178] Initializing hf model, with arguments: {'pretrained': '/lm-evaluation-harness/checkpoints_to_eval/CT-LLM-SFT-DPO', 'trust_remote_code': True, 'dtype': 'float16'}
2024-05-10:13:52:30,301 WARNING  [logging.py:61] Detected kernel version 4.14.105, which is below the recommended minimum of 5.5.0; this can cause the process to hang. It is recommended to upgrade the kernel to the minimum version or higher.
2024-05-10:13:52:30,301 INFO     [huggingface.py:165] Using device 'cuda'
Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
Traceback (most recent call last):
  File "/lm-evaluation-harness/main.py", line 416, in <module>
    cli_evaluate()
  File "/lm-evaluation-harness/main.py", line 347, in cli_evaluate
    results = evaluator.simple_evaluate(
  File "/lm-evaluation-harness/lm_eval/utils.py", line 321, in _wrapper
    return fn(*args, **kwargs)
  File "/lm-evaluation-harness/lm_eval/evaluator.py", line 210, in simple_evaluate
    task_dict = get_task_dict(tasks, task_manager)
  File "/lm-evaluation-harness/lm_eval/tasks/__init__.py", line 421, in get_task_dict
    task_name_from_string_dict = task_manager.load_task_or_group(
  File "/lm-evaluation-harness/lm_eval/tasks/__init__.py", line 271, in load_task_or_group
    collections.ChainMap(*map(self._load_individual_task_or_group, task_list))
  File "/lm-evaluation-harness/lm_eval/tasks/__init__.py", line 254, in _load_individual_task_or_group
    **dict(collections.ChainMap(*map(fn, subtask_list))),
  File "/lm-evaluation-harness/lm_eval/tasks/__init__.py", line 162, in _load_individual_task_or_group
    return load_task(task_config, task=name_or_config, group=parent_name)
  File "/lm-evaluation-harness/lm_eval/tasks/__init__.py", line 151, in load_task
    task_object = ConfigurableTask(config=config)
  File "/lm-evaluation-harness/lm_eval/api/task.py", line 796, in __init__
    self.download(self.config.dataset_kwargs)
  File "/lm-evaluation-harness/lm_eval/api/task.py", line 903, in download
    self.dataset = datasets.load_dataset(
  File "/usr/local/python/lib/python3.8/site-packages/datasets/load.py", line 2129, in load_dataset
    builder_instance = load_dataset_builder(
  File "/usr/local/python/lib/python3.8/site-packages/datasets/load.py", line 1852, in load_dataset_builder
    builder_instance: DatasetBuilder = builder_cls(
  File "/usr/local/python/lib/python3.8/site-packages/datasets/builder.py", line 373, in __init__
    self.config, self.config_id = self._create_builder_config(
  File "/usr/local/python/lib/python3.8/site-packages/datasets/builder.py", line 560, in _create_builder_config
    raise ValueError(f"BuilderConfig {builder_config} doesn't have a '{key}' key.")
ValueError: BuilderConfig BuilderConfig(name='algebra', version=0.0.1, data_dir=None, data_files=None, description='algebra') doesn't have a 'trust_remote_code' key.
```

Hi!

- Does `minerva_math_algebra` or other tasks build successfully?
- What is your `datasets` version?

closing as can't replicate this, let me know if you have environment details or a way to replicate this on a fresh install.