Repository: open-compass/opencompass
Issue: [Bug] MATH-500 MATHEvaluator is not in the opencompass::icl_evaluators registry.
Root cause: Validation Gap

### Prerequisite

- [x] I have searched [Issues](https://github.com/open-compass/opencompass/issues/) and [Discussions](https://github.com/open-compass/opencompass/discussions) but cannot get the expected help.
- [x] The bug has not been fixed in the [latest version](https://github.com/open-compass/opencompass).

### Type

I'm evaluating with the officially supported tasks/models/datasets.

### Environment

(smoothquantpre) [maoshizhuo@ISPC-GPU2-CS opencompass]$ TOKENIZERS_PARALLELISM=false python run.py     --datasets math_500_gen     --hf-type base     --hf-path /nHome/maoshizhuo/2025/deepseek-Qwen-1.5B     --debug     --max-out-len 512 --generation-kwargs do_sample=True top_k=50 top_p=0.95
04/06 17:57:28 - OpenCompass - INFO - Loading math_500_gen: /nHome/maoshizhuo/2025/opencompass/opencompass/configs/./datasets/math/math_500_gen.py
04/06 17:57:28 - OpenCompass - INFO - Loading example: /nHome/maoshizhuo/2025/opencompass/opencompass/configs/./summarizers/example.py
04/06 17:57:28 - OpenCompass - INFO - Current exp folder: outputs/default/20250406_175728
04/06 17:57:28 - OpenCompass - WARNING - SlurmRunner is not used, so the partition argument is ignored.
04/06 17:57:28 - OpenCompass - INFO - Partitioned into 1 tasks.
04/06 17:57:29 - OpenCompass - INFO - Task [deepseek-Qwen-1.5B_hf/math-500]
更改有效！！！！
04/06 17:57:40 - OpenCompass - INFO - Try to load the data from /nHome/maoshizhuo/.cache/opencompass/./data/math/
04/06 17:57:40 - OpenCompass - INFO - Start inferencing [deepseek-Qwen-1.5B_hf/math-500]
[2025-04-06 17:57:40,267] [opencompass.openicl.icl_inferencer.icl_gen_inferencer] [INFO] Starting build dataloader
[2025-04-06 17:57:40,267] [opencompass.openicl.icl_inferencer.icl_gen_inferencer] [INFO] Starting inference process...
100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 63/63 [16:39<00:00, 15.86s/it]
04/06 18:14:19 - OpenCompass - INFO - Partitioned into 1 tasks.
04/06 18:14:21 - OpenCompass - INFO - Try to load the data from /nHome/maoshizhuo/.cache/opencompass/./data/math/
Traceback (most recent call last):
  File "/nHome/maoshizhuo/2025/opencompass/run.py", line 6, in <module>
    main()
  File "/nHome/maoshizhuo/2025/opencompass/opencompass/cli/main.py", line 351, in main
    runner(tasks)
  File "/nHome/maoshizhuo/2025/opencompass/opencompass/runners/base.py", line 38, in __call__
    status = self.launch(tasks)
  File "/nHome/maoshizhuo/2025/opencompass/opencompass/runners/local.py", line 136, in launch
    task.run()
  File "/nHome/maoshizhuo/2025/opencompass/opencompass/tasks/openicl_eval.py", line 70, in run
    self._score()
  File "/nHome/maoshizhuo/2025/opencompass/opencompass/tasks/openicl_eval.py", line 195, in _score
    icl_evaluator = ICL_EVALUATORS.build(self.eval_cfg['evaluator'])
  File "/nHome/maoshizhuo/anaconda3/envs/smoothquantpre/lib/python3.10/site-packages/mmengine/registry/registry.py", line 570, in build
    return self.build_func(cfg, *args, **kwargs, registry=self)
  File "/nHome/maoshizhuo/anaconda3/envs/smoothquantpre/lib/python3.10/site-packages/mmengine/registry/build_functions.py", line 102, in build_from_cfg
    raise KeyError(
KeyError: 'opencompass.openicl.icl_evaluator.math_evaluator.MATHEvaluator is not in the opencompass::icl_evaluators registry. Please check whether the value of `opencompass.openicl.icl_evaluator.math_evaluator.MATHEvaluator` is correct or it was registered as expected. More details can be found at https://mmengine.readthedocs.io/en/latest/advanced_tutorials/config.html#import-the-custom-module'


### Reproduces the problem - code/configuration sample

python run.py     --datasets math_500_gen     --hf-type base     --hf-path /nHome/maoshizhuo/2025/deepseek-Qwen-1.5B     --debug     --max-out-len 512 --generation-kwargs do_sample=True top_k=50 top_p=0.95

### Reproduces the problem - command or script

python run.py     --datasets math_500_gen     --hf-type base     --hf-path /nHome/maoshizhuo/2025/deepseek-Qwen-1.5B     --debug     --max-out-len 512 --generation-kwargs do_sample=True top_k=50 top_p=0.95

### Reproduces the problem - error message

Traceback (most recent call last):
  File "/nHome/maoshizhuo/2025/opencompass/run.py", line 6, in <module>
    main()
  File "/nHome/maoshizhuo/2025/opencompass/opencompass/cli/main.py", line 351, in main
    runner(tasks)
  File "/nHome/maoshizhuo/2025/opencompass/opencompass/runners/base.py", line 38, in __call__
    status = self.launch(tasks)
  File "/nHome/maoshizhuo/2025/opencompass/opencompass/runners/local.py", line 136, in launch
    task.run()
  File "/nHome/maoshizhuo/2025/opencompass/opencompass/tasks/openicl_eval.py", line 70, in run
    self._score()
  File "/nHome/maoshizhuo/2025/opencompass/opencompass/tasks/openicl_eval.py", line 195, in _score
    icl_evaluator = ICL_EVALUATORS.build(self.eval_cfg['evaluator'])
  File "/nHome/maoshizhuo/anaconda3/envs/smoothquantpre/lib/python3.10/site-packages/mmengine/registry/registry.py", line 570, in build
    return self.build_func(cfg, *args, **kwargs, registry=self)
  File "/nHome/maoshizhuo/anaconda3/envs/smoothquantpre/lib/python3.10/site-packages/mmengine/registry/build_functions.py", line 102, in build_from_cfg
    raise KeyError(
KeyError: 'opencompass.openicl.icl_evaluator.math_evaluator.MATHEvaluator is not in the opencompass::icl_evaluators registry. Please check whether the value of `opencompass.openicl.icl_evaluator.math_evaluator.MATHEvaluator` is correct or it was registered as expected. More details can be found at https://mmengine.readthedocs.io/en/latest/advanced_tutorials/config.html#import-the-custom-module'


### Other information

_No response_

可以跑通63个samples，但是在得出分数的最后一下报错，似乎是注册表还未更新MATH-500的计分方式

Would you please provide your environment information by running the following command? 
```
python -c "import opencompass.utils;import pprint;pprint.pprint(dict(opencompass.utils.collect_env()))"
```

> Would you please provide your environment information by running the following command?
> 
> ```
> python -c "import opencompass.utils;import pprint;pprint.pprint(dict(opencompass.utils.collect_env()))"
> ```

Thanks for your attention! I have solved this problem by reclone the newest version of the code.

@msz12345 Sounds good! Closing this issue. Feel free to re-open if more help is needed.