Repository: modelscope/evalscope
Issue: opencompass评测时卡住一直不动
Root cause: Environment Incompatibility

## 自查清单

在提交 issue 之前，请确保您已完成以下步骤:
- [x] 我已仔细阅读了[相关使用说明文档](https://evalscope.readthedocs.io/zh-cn/latest/get_started/parameters.html)
- [x] 我已查看了[常见问题解答](https://evalscope.readthedocs.io/zh-cn/latest/get_started/faq.html)
- [x] 我已搜索并查看了现有的 issues，确认这不是一个重复的问题

## 问题描述

执行python example_eval_openai_api.py时卡住了。



## EvalScope 版本（必填）
v0.15.1

## 使用的工具
- [x] Opencompass backend

## 执行的代码或指令

python example_eval_openai_api.py

## 错误日志

请粘贴完整的错误日志或控制台输出。
python example_eval_openai_api.py
2025-05-19 15:05:17,268 - evalscope - INFO - Args: Task config is provided with dictionary type.
2025-05-19 15:05:17,479 - evalscope - INFO - Check the OpenCompass environment: OK
2025-05-19 15:05:17,482 - evalscope - INFO - Dump task config to ./outputs/20250519_150517/configs/task_config_5de96f.yaml
2025-05-19 15:05:17,483 - evalscope - INFO - {
    "model": "DummyCustomModel",
    "model_id": "dummy-model",
    "model_args": {
        "revision": "master",
        "precision": "torch.float16"
    },
    "model_task": "text_generation",
    "template_type": null,
    "chat_template": null,
    "datasets": [],
    "dataset_args": {},
    "dataset_dir": "/mnt/workspace/.cache/modelscope/hub/datasets",
    "dataset_hub": "modelscope",
    "generation_config": {
        "max_length": 2048,
        "max_new_tokens": 512,
        "do_sample": false,
        "top_k": 50,
        "top_p": 1.0,
        "temperature": 1.0
    },
    "eval_type": "custom",
    "eval_backend": "OpenCompass",
    "eval_config": {
        "datasets": [
            "ceval"
        ],
        "models": [
            {
                "path": "/nfs/largemodel/model/DeepSeek-R1-Distill-Llama-70B",
                "openai_api_base": "http://127.0.0.1:8877/v1/chat/completions",
                "is_chat": true,
                "batch_size": 16
            }
        ],
        "work_dir": "outputs/DeepSeek-R1-Distill-Llama-70B_eval_result",
        "limit": 10,
        "time_str": "20250519_150517"
    },
    "stage": "all",
    "limit": null,
    "eval_batch_size": 1,
    "mem_cache": false,
    "use_cache": null,
    "work_dir": "./outputs/20250519_150517",
    "outputs": null,
    "debug": false,
    "dry_run": false,
    "seed": 42,
    "api_url": null,
    "api_key": "EMPTY",
    "timeout": null,
    "stream": false,
    "judge_strategy": "auto",
    "judge_worker_num": 1,
    "judge_model_args": {}
}
[2025-05-19 15:05:20,175] [INFO] [real_accelerator.py:239:get_accelerator] Setting ds_accelerator to cuda (auto detect)
INFO 05-19 15:05:21 [__init__.py:239] Automatically detected platform cuda.
2025-05-19 15:05:23,823 - evalscope - INFO - *** Run task with config: /tmp/tmp2paj5sr6.py 

05/19 15:05:23 - OpenCompass - INFO - Current exp folder: outputs/DeepSeek-R1-Distill-Llama-70B_eval_result/20250519_150517
05/19 15:05:25 - OpenCompass - WARNING - SlurmRunner is not used, so the partition argument is ignored.
05/19 15:05:25 - OpenCompass - INFO - Partitioned into 52 tasks.
launch OpenICLInfer[/nfs/largemodel/model/DeepSeek-R1-Distill-Llama-70B/ceval-computer_network] on CPU                                                                                          
launch OpenICLInfer[/nfs/largemodel/model/DeepSeek-R1-Distill-Llama-70B/ceval-operating_system] on CPU                                                                                          
launch OpenICLInfer[/nfs/largemodel/model/DeepSeek-R1-Distill-Llama-70B/ceval-computer_architecture] on CPU                                                                                     
launch OpenICLInfer[/nfs/largemodel/model/DeepSeek-R1-Distill-Llama-70B/ceval-college_programming] on CPU                                                                                       
  0%|                                                                                                                                                                    | 0/52 [00:00<?, ?it/s]
## 运行环境

- 操作系统：linux
- Python版本：3.11.11

## 其他信息
example_eval_openai_api.py内容如下：
from evalscope.run import run_task
from evalscope.summarizer import Summarizer
task_cfg_dict = dict(
    eval_backend='OpenCompass',
    eval_config={
        'datasets':['ceval'],
        'models': [
            {'path': '/nfs/largemodel/model/DeepSeek-R1-Distill-Llama-70B', 
            'openai_api_base': 'http://127.0.0.1:8877/v1/chat/completions', 
            'is_chat': True,
            'batch_size': 16},
        ],
        'work_dir': 'outputs/DeepSeek-R1-Distill-Llama-70B_eval_result',
        'limit': 10,
        },
    )
    
def run_eval():
    # 选项 1: python 字典
    task_cfg = task_cfg_dict

    # 选项 2: yaml 配置文件
    # task_cfg = 'eval_openai_api.yaml'

    # 选项 3: json 配置文件
    # task_cfg = 'eval_openai_api.json'

    run_task(task_cfg=task_cfg)

    print('>> Start to get the report with summarizer ...')
    report_list = Summarizer.get_report_from_cfg(task_cfg)
    print(f'\n>> The report list: {report_list}')

run_eval()
如果有其他相关信息，请在此处提供。


outputs文件夹下输出的内容有在更新吗，看你给的log是在进行评测啊，可能速度有点慢

> outputs文件夹下输出的内容有在更新吗，看你给的log是在进行评测啊，可能速度有点慢

刚测试成功了，因为我刚开始加了代理，所以一直没有通信成功，把代理取消就好了。


> 感谢你的反馈！我们将关闭此问题。如果您有任何疑问，请随时重新打开它。如果EvalScope对您有所帮助，欢迎给我们点个STAR以示支持，谢谢！