Repository: modelscope/evalscope
Issue: AIME2025 KeyError with `evalscope perf --dataset aime25` Command
Root cause: Documentation Deficiency

## Self-Check List

Before submitting an issue, please ensure you have completed the following steps:
- [x] I have carefully read the [relevant user documentation](https://evalscope.readthedocs.io/en/latest/get_started/parameters.html)
- [x] I have reviewed the [Frequently Asked Questions](https://evalscope.readthedocs.io/en/latest/get_started/faq.html)
- [x] I have searched and reviewed existing issues to confirm this is not a duplicate problem

## Problem Description

According to the documentation, AIME2025 should be supported, but it's giving me the keyerror. 

## EvalScope Version (Required)
v0.16.3

## Tools Used
- [ ] Native / Native framework
- [x] Opencompass backend
- [ ] VLMEvalKit backend
- [ ] RAGEval backend
- [x] Perf / Model inference stress testing tool
- [ ] Arena / Arena mode

## Executed Code or Instructions

```
evalscope perf \
    --url "http://127.0.0.1:8801/v1/chat/completions" \
    --parallel 10 \
    --model Qwen3-32B \
    --number 1 \
    --api openai \
    --dataset aime25 \
    --max-tokens 131072 
```

## Error Log

```
2025-07-03 22:17:19,681 - evalscope - INFO - Test connection successful.
2025-07-03 22:17:19,681 - evalscope - ERROR - Exception in async function 'benchmark': 'aime25'
Traceback (most recent call last):
  File "/fsx/home/huanzhi.mao/evalscope/evalscope/perf/utils/handler.py", line 17, in async_wrapper
    return await func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/fsx/home/huanzhi.mao/evalscope/evalscope/perf/benchmark.py", line 197, in benchmark
    async for request in get_requests(args):
  File "/fsx/home/huanzhi.mao/evalscope/evalscope/perf/benchmark.py", line 75, in get_requests
    async for request in generator:
  File "/fsx/home/huanzhi.mao/evalscope/evalscope/perf/benchmark.py", line 41, in generate_requests_from_dataset
    message_generator_class = DatasetRegistry(args.dataset)
                              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/fsx/home/huanzhi.mao/evalscope/evalscope/perf/plugin/registry.py", line 20, in __call__
    return self.get_class(name)
           ^^^^^^^^^^^^^^^^^^^^
  File "/fsx/home/huanzhi.mao/evalscope/evalscope/perf/plugin/registry.py", line 14, in get_class
    return self._registry[name]
           ~~~~~~~~~~~~~~^^^^^^
KeyError: 'aime25'
<frozen abc>:123: RuntimeWarning: coroutine 'statistic_benchmark_metric' was never awaited
RuntimeWarning: Enable tracemalloc to get the object allocation traceback
2025-07-03 22:17:19,690 - asyncio - ERROR - Task was destroyed but it is pending!
task: <Task pending name='Task-8' coro=<statistic_benchmark_metric() running at /fsx/home/huanzhi.mao/evalscope/evalscope/perf/utils/handler.py:14>>
```

## Running Environment

- Operating System: Linux
- Python Version: 3.10

## Additional Information

If there is any other relevant information, please provide it here.


According to the documentation, the datasets supported by perf are listed here: https://evalscope.readthedocs.io/en/latest/user_guides/stress_test/parameters.html#dataset-configuration. "aime25" is a dataset supported by eval, not perf.

@Yunnglin Thanks for catching that! I went ahead and switched to the perf command, and everything is working as expected. Appreciate the help!