Repository: modelscope/evalscope
Issue: 自定义数据集 is empty
Root cause: External Dependency Breakage

## 自查清单

在提交 issue 之前，请确保您已完成以下步骤:
- [x] 我已仔细阅读了[相关使用说明文档](https://evalscope.readthedocs.io/zh-cn/latest/get_started/parameters.html)
- [x] 我已查看了[常见问题解答](https://evalscope.readthedocs.io/zh-cn/latest/get_started/faq.html)
- [x] 我已搜索并查看了现有的 issues，确认这不是一个重复的问题

## 问题描述

使用自定义数据集时，qa类型的测试没有问题，但是mcq的会报ValueError: Dataset is empty: /mnt/dolphinfs/hdd_pool/docker/user/hadoop-fsprisk/fudesheng/playground/EvalScopeX/custome_MCQ_dataset/mcq_dataset

我确认里面是有内容的，head这个dataset里的内容会输出：
{"id": "4222362", "question": "What is George Rankin's occupation?", "A": "politician", "B": "political leader", "C": "political figure", "D": "polit.", "E": "pol", "answer": "A"}
{"id": "4725190", "question": "What is John Mayne's occupation?", "A": "journalist", "B": "journo", "C": "journalists", "answer": "A"}
{"id": "4382392", "question": "What is Henry Feilden's occupation?", "A": "politician", "B": "political leader", "C": "political figure", "D": "polit.", "E": "pol", "answer": "A"}
## EvalScope 版本（必填）
v0.xx.x

## 使用的工具
- [ ] Native / 原生框架
- [ ] Opencompass backend
- [ ] VLMEvalKit backend
- [ ] RAGEval backend
- [ ] Perf / 模型推理压测工具
- [ ] Arena / 竞技场模式

## 执行的代码或指令
from evalscope import TaskConfig, run_task

task_cfg = TaskConfig(
    model='/mnt/dolphinfs/hdd_pool/docker/user/hadoop-fsprisk/fudesheng/playground/pretrained_model/model/huggingface.co/Qwen/Qwen2.5-0.5B-Instruct',
    datasets=['general_mcq'],  # 数据格式，选择题格式固定为 'general_mcq'
    dataset_args={
        'general_mcq': {
            "local_path": "/mnt/dolphinfs/hdd_pool/docker/user/hadoop-fsprisk/fudesheng/playground/EvalScopeX/custome_MCQ_dataset/mcq",  # 自定义数据集路径
            "subset_list": [
                "pqa"  # 评测数据集名称，上述subset_name
            ]
        }
    },
)
请提供您执行的主要代码或指令。
2025-06-30 21:03:55,834 - evalscope - INFO - **** Start evaluating on dataset /mnt/dolphinfs/hdd_pool/docker/user/hadoop-fsprisk/fudesheng/playground/EvalScopeX/custome_MCQ_dataset/mcq_dataset/pqa.jsonl ****
2025-06-30 21:03:55,836 - evalscope - INFO - Loading dataset from local disk: /mnt/dolphinfs/hdd_pool/docker/user/hadoop-fsprisk/fudesheng/playground/EvalScopeX/custome_MCQ_dataset/mcq_dataset/pqa.jsonl
Traceback (most recent call last):
  File "/mnt/dolphinfs/hdd_pool/docker/user/hadoop-fsprisk/tools/env_bk/evalscope/bin/evalscope", line 8, in <module>
    sys.exit(run_cmd())
  File "/mnt/dolphinfs/hdd_pool/docker/user/hadoop-fsprisk/tools/env_bk/evalscope/lib/python3.10/site-packages/evalscope/cli/cli.py", line 25, in run_cmd
    cmd.execute()
  File "/mnt/dolphinfs/hdd_pool/docker/user/hadoop-fsprisk/tools/env_bk/evalscope/lib/python3.10/site-packages/evalscope/cli/start_eval.py", line 32, in execute
    run_task(self.args)
  File "/mnt/dolphinfs/hdd_pool/docker/user/hadoop-fsprisk/tools/env_bk/evalscope/lib/python3.10/site-packages/evalscope/run.py", line 31, in run_task
    return run_single_task(task_cfg, run_time)
  File "/mnt/dolphinfs/hdd_pool/docker/user/hadoop-fsprisk/tools/env_bk/evalscope/lib/python3.10/site-packages/evalscope/run.py", line 44, in run_single_task
    result = evaluate_model(task_cfg, outputs)
  File "/mnt/dolphinfs/hdd_pool/docker/user/hadoop-fsprisk/tools/env_bk/evalscope/lib/python3.10/site-packages/evalscope/run.py", line 126, in evaluate_model
    res_dict = evaluator.eval()
  File "/mnt/dolphinfs/hdd_pool/docker/user/hadoop-fsprisk/tools/env_bk/evalscope/lib/python3.10/site-packages/evalscope/evaluator/evaluator.py", line 440, in eval
    prompts = self.load_dataset()
  File "/mnt/dolphinfs/hdd_pool/docker/user/hadoop-fsprisk/tools/env_bk/evalscope/lib/python3.10/site-packages/evalscope/evaluator/evaluator.py", line 73, in load_dataset
    dataset = self.data_adapter.load(
  File "/mnt/dolphinfs/hdd_pool/docker/user/hadoop-fsprisk/tools/env_bk/evalscope/lib/python3.10/site-packages/evalscope/benchmarks/data_adapter.py", line 107, in load
    raise ValueError(f'Dataset is empty: {dataset_name_or_path}')
ValueError: Dataset is empty: /mnt/dolphinfs/hdd_pool/docker/user/hadoop-fsprisk/fudesheng/playground/EvalScopeX/custome_MCQ_dataset/mcq_dataset/pqa.jsonl
(/mnt/dolphinfs/hdd_pool/docker/user/hadoop-fsprisk/tools/env_bk/evalscope) [hadoop-hmart-fsp-ml@set-zw04-mlp-codelab-pc101 EvalScopeX]$ pwd
/mnt/dolphinfs/hdd_pool/docker/user/hadoop-fsprisk/fudesheng/playground/EvalScopeX
## 错误日志

请粘贴完整的错误日志或控制台输出。

## 运行环境

- 操作系统：
- Python版本：

## 其他信息

如果有其他相关信息，请在此处提供。


请问使用的是main分支的代码吗，如果不是的话，请尝试使用main分支代码

请问main分支的代码是指的什么，我用的evalscope官方文档里的命令格式，在evalscope环境下运行的，我发现把数据整理成_val.csv格式可以识别到，但是_val.jsonl格式会报数据集is empty

如果是pip安装的包，还不支持jsonl格式的数据。最新代码在github的main分支中，过几天会发新版本

新版本已发布

> 感谢你的反馈！我们将关闭此问题。如果您有任何疑问，请随时重新打开它。如果EvalScope对您有所帮助，欢迎给我们点个STAR以示支持，谢谢！