Repository: modelscope/evalscope
Issue: Qwen3-VL-30B-A3B-Instruct-FP8，omni_doc_bench精度异常
Root cause: Validation Gap

## 自查清单

在提交 issue 之前，请确保您已完成以下步骤:
- [x] 我已仔细阅读了[相关使用说明文档](https://evalscope.readthedocs.io/zh-cn/latest/get_started/parameters.html)
- [x] 我已查看了[常见问题解答](https://evalscope.readthedocs.io/zh-cn/latest/get_started/faq.html)
- [x] 我已搜索并查看了现有的 issues，确认这不是一个重复的问题

## 问题描述

请简要描述您遇到的问题。

## EvalScope 版本（必填）
0.0.0.dev0
Commit: ef34c04b

## 使用的工具
- [x] Native / 原生框架
- [ ] Opencompass backend
- [ ] VLMEvalKit backend
- [ ] RAGEval backend
- [ ] Perf / 模型推理压测工具
- [ ] Arena / 竞技场模式

## 执行的代码或指令
```python
from evalscope import TaskConfig, run_task
from evalscope.constants import EvalType, JudgeStrategy

task_cfg = TaskConfig(
    model='Qwen3-VL-30B-A3B-Instruct-FP8',
    api_url='http://0.0.0.0:8090/v1',
    api_key='API_KEY',
    eval_type=EvalType.SERVICE,
    datasets=[
        'omni_doc_bench', 
    ],

    eval_batch_size=32,
    # https://github.com/QwenLM/Qwen3-VL?tab=readme-ov-file#instruct-models
    generation_config={
        'max_tokens': 32768,  # 最大生成token数，建议设置为较大值避免输出截断
        'temperature': 0.7,  # 采样温度 (qwen 报告推荐值)
        'top_p': 0.8,  # top-p采样 (qwen 报告推荐值)
        'top_k': 20,  # top-k采样 (qwen 报告推荐值)
        'repetition_penalty': 1.0,  # 重复惩罚系数
        'presence_penalty': 1.5,  # 新内容惩罚系数
        'n': 1,  # 每个请求产生的回复数量
    },
    repeats=5,
    # judge_worker_num=8,
    # judge_strategy=JudgeStrategy.LLM_RECALL,
    # judge_model_args={
    #     'model_id': 'Qwen3-8B',
    #     'api_url': 'http://0.0.0.0:8091/v1',
    #     'api_key': 'EMPTY',
    # },
    # limit=10,  # 设置为100条数据进行测试
    # timeout=60000,
    # use_cache='outputs/20251215_112047'
)

run_task(task_cfg=task_cfg)
```

## 错误日志
- 看起来结果不正常

<img width="1603" height="1350" alt="Image" src="https://github.com/user-attachments/assets/59d3cbe9-58d9-462a-9a58-d67d7cba1fda" />

<details><summary>click to show</summary>
    
    2025-12-15 16:20:20 - evalscope - INFO: Aggregating scores for subset: default
    2025-12-15 16:22:36,643 - pylatexenc.latexwalker - INFO: Ignoring parse error (tolerant parsing mode): Unexpected mismatching closing brace: '}' @(1,4)
    2025-12-15 16:22:36,651 - pylatexenc.latexwalker - INFO: Ignoring parse error (tolerant parsing mode): Unexpected mismatching closing brace: '}' @(1,4)
    2025-12-15 16:22:38,152 - pylatexenc.latexwalker - INFO: Ignoring parse error (tolerant parsing mode): Unexpected mismatching closing brace: '}' @(1,4)
    2025-12-15 16:22:38,166 - pylatexenc.latexwalker - INFO: Ignoring parse error (tolerant parsing mode): Unexpected mismatching closing brace: '}' @(1,4)
    2025-12-15 16:22:38,178 - pylatexenc.latexwalker - INFO: Ignoring parse error (tolerant parsing mode): Unexpected mismatching closing brace: '}' @(1,4)
    2025-12-15 16:27:57,374 - pylatexenc.latexwalker - INFO: Ignoring parse error (tolerant parsing mode): Unexpected mismatching closing brace: '}' @(1,0)
    2025-12-15 16:27:57,466 - pylatexenc.latexwalker - INFO: Ignoring parse error (tolerant parsing mode): Unexpected mismatching closing brace: '}' @(1,0)
    2025-12-15 16:27:57,533 - pylatexenc.latexwalker - INFO: Ignoring parse error (tolerant parsing mode): Unexpected mismatching closing brace: '}' @(1,0)
    2025-12-15 16:27:58,053 - pylatexenc.latexwalker - INFO: Ignoring parse error (tolerant parsing mode): Unexpected mismatching closing brace: '}' @(1,0)
    2025-12-15 16:27:58,145 - pylatexenc.latexwalker - INFO: Ignoring parse error (tolerant parsing mode): Unexpected mismatching closing brace: '}' @(1,0)
    Building prefix dict from the default dictionary ...
    2025-12-15 16:29:21,617 - jieba - DEBUG: Building prefix dict from the default dictionary ...
    Loading model from cache /tmp/jieba.cache
    2025-12-15 16:29:21,618 - jieba - DEBUG: Loading model from cache /tmp/jieba.cache
    Loading model cost 0.407 seconds.
    2025-12-15 16:29:22,025 - jieba - DEBUG: Loading model cost 0.407 seconds.
    Prefix dict has been built successfully.
    2025-12-15 16:29:22,025 - jieba - DEBUG: Prefix dict has been built successfully.
    2025-12-15 16:30:10 - evalscope - INFO: text_block
    2025-12-15 16:30:10 - evalscope - INFO: 
    Edit_dist:
    ------------  --------
    ALL_page_avg  0.171464
    ------------  --------
    ====================================================================================================
    2025-12-15 16:30:10 - evalscope - INFO: 
    BLEU:
    ---  --------
    all  0.311985
    ---  --------
    ====================================================================================================
    2025-12-15 16:30:10 - evalscope - INFO: 
    METEOR:
    ---  --------
    all  0.468499
    ---  --------
    ====================================================================================================
    2025-12-15 16:30:11 - evalscope - INFO: ----Anno Attribute---------------
    2025-12-15 16:30:11 - evalscope - INFO: 
    Edit_dist:
    --------------------------------------  ---------
    text_background: multi_colored          0.134526
    text_background: single_colored         0.275941
    text_background: white                  0.342016
    text_language: text_en_ch_mixed         0.161242
    text_language: text_english             0.0773151
    text_language: text_simplified_chinese  0.410449
    text_rotate: horizontal                 0.481139
    text_rotate: normal                     0.318401
    text_rotate: rotate270                  0.936797
    text_rotate: rotate90                   0.359089
    --------------------------------------  ---------
    ====================================================================================================
    2025-12-15 16:30:11 - evalscope - INFO: 
    sample_count:
    --------------------------------------  -----
    text_background: multi_colored           4844
    text_background: single_colored          2781
    text_background: white                  45510
    text_language: text_en_ch_mixed          1212
    text_language: text_english             13606
    text_language: text_simplified_chinese  38340
    text_rotate: horizontal                   243
    text_rotate: normal                     52346
    text_rotate: rotate270                    151
    text_rotate: rotate90                       5
    --------------------------------------  -----
    ====================================================================================================
    2025-12-15 16:30:11 - evalscope - INFO: 
    Edit_dist:
    --------------------------------  ---------
    ALL                               0.171464
    None                              0.0633219
    colorful_backgroud                0.110914
    data_source: PPT2PDF              0.0918443
    data_source: academic_literature  0.0697793
    data_source: book                 0.104837
    data_source: colorful_textbook    0.131881
    data_source: exam_paper           0.112665
    data_source: magazine             0.0967839
    data_source: newspaper            0.631978
    data_source: note                 0.175341
    data_source: research_report      0.0967153
    fuzzy_scan                        0.0639517
    language: en_ch_mixed             0.137255
    language: english                 0.0856132
    language: simplified_chinese      0.217966
    layout: 1andmore_column           0.0708182
    layout: double_column             0.0920095
    layout: other_layout              0.39406
    layout: single_column             0.115984
    layout: three_column              0.155068
    watermark                         0.113138
    --------------------------------  ---------
    ====================================================================================================
    2025-12-15 16:30:11 - evalscope - INFO: display_formula
    2025-12-15 16:30:11 - evalscope - INFO: 
    Edit_dist:
    ------------  --------
    ALL_page_avg  0.406418
    ------------  --------
    ====================================================================================================
    2025-12-15 16:30:11 - evalscope - INFO: ----Anno Attribute---------------
    2025-12-15 16:30:11 - evalscope - INFO: 
    Edit_dist:
    -------------------------  --------
    formula_type: handwriting  0.859
    formula_type: print        0.494401
    -------------------------  --------
    ====================================================================================================
    2025-12-15 16:30:11 - evalscope - INFO: 
    sample_count:
    -------------------------  ----
    formula_type: handwriting    20
    formula_type: print        1734
    -------------------------  ----
    ====================================================================================================
    2025-12-15 16:30:11 - evalscope - INFO: 
    Edit_dist:
    --------------------------------  --------
    ALL                               0.406418
    None                              0.410703
    colorful_backgroud                0.393126
    data_source: PPT2PDF              0.313068
    data_source: academic_literature  0.294685
    data_source: book                 0.420834
    data_source: colorful_textbook    0.442807
    data_source: exam_paper           0.419672
    data_source: note                 1
    fuzzy_scan                        0.525981
    language: english                 0.35311
    language: simplified_chinese      0.438727
    layout: 1andmore_column           0.316984
    layout: double_column             0.442932
    layout: other_layout              0.407138
    layout: single_column             0.363549
    layout: three_column              0.667193
    watermark                         0.514564
    --------------------------------  --------
    ====================================================================================================
    2025-12-15 16:31:01 - evalscope - INFO: table
    2025-12-15 16:31:01 - evalscope - INFO: 
    TEDS:
    ---  --------
    all  0.334744
    ---  --------
    ====================================================================================================
    2025-12-15 16:31:01 - evalscope - INFO: 
    TEDS_structure_only:
    ---  --------
    all  0.362785
    ---  --------
    ====================================================================================================
    2025-12-15 16:31:01 - evalscope - INFO: 
    Edit_dist:
    ------------  --------
    ALL_page_avg  0.719257
    ------------  --------
    ====================================================================================================
    2025-12-15 16:31:01 - evalscope - INFO: ----Anno Attribute---------------
    2025-12-15 16:31:01 - evalscope - INFO: 
    Edit_dist:
    ----------------------------------  --------
    include_background: False           0.792719
    include_background: True            0.660541
    include_equation: False             0.744255
    include_equation: True              0.768617
    include_photo: False                0.748866
    language: table_en                  0.76038
    language: table_en_ch_mixed         0.646512
    language: table_simplified_chinese  0.749082
    line: fewer_line                    0.871247
    line: full_line                     0.65143
    line: less_line                     0.801202
    line: wireless_line                 0.658825
    table_layout: horizontal            0.745579
    table_layout: vertical              0.946562
    with_span: False                    0.7349
    with_span: True                     0.774749
    with_structured_text: False         0.747781
    with_structured_text: True          0.778734
    ----------------------------------  --------
    ====================================================================================================
    2025-12-15 16:31:01 - evalscope - INFO: 
    TEDS:
    ----------------------------------  --------
    include_background: False           0.295729
    include_background: True            0.413325
    include_equation: False             0.343
    include_equation: True              0.299377
    include_photo: False                0.334744
    language: table_en                  0.315843
    language: table_en_ch_mixed         0.450268
    language: table_simplified_chinese  0.337153
    line: fewer_line                    0.171385
    line: full_line                     0.459078
    line: less_line                     0.25251
    line: wireless_line                 0.593602
    table_layout: horizontal            0.33947
    table_layout: vertical              0.050524
    with_span: False                    0.37779
    with_span: True                     0.254966
    with_structured_text: False         0.338151
    with_structured_text: True          0.240945
    ----------------------------------  --------
    ====================================================================================================
    2025-12-15 16:31:01 - evalscope - INFO: 
    TEDS_structure_only:
    ----------------------------------  ---------
    include_background: False           0.32109
    include_background: True            0.446763
    include_equation: False             0.368856
    include_equation: True              0.336777
    include_photo: False                0.362785
    language: table_en                  0.347642
    language: table_en_ch_mixed         0.466144
    language: table_simplified_chinese  0.364147
    line: fewer_line                    0.18241
    line: full_line                     0.496518
    line: less_line                     0.281147
    line: wireless_line                 0.660028
    table_layout: horizontal            0.367919
    table_layout: vertical              0.0540081
    with_span: False                    0.403772
    with_span: True                     0.286822
    with_structured_text: False         0.366272
    with_structured_text: True          0.266788
    ----------------------------------  ---------
    ====================================================================================================
    2025-12-15 16:31:01 - evalscope - INFO: 
    sample_count:
    ----------------------------------  ----
    include_background: False           1430
    include_background: True             710
    include_equation: False             1735
    include_equation: True               405
    include_photo: False                2140
    language: table_en                   640
    language: table_en_ch_mixed           75
    language: table_simplified_chinese  1425
    line: fewer_line                     735
    line: full_line                     1025
    line: less_line                      310
    line: wireless_line                   70
    table_layout: horizontal            2105
    table_layout: vertical                35
    with_span: False                    1390
    with_span: True                      750
    with_structured_text: False         2065
    with_structured_text: True            75
    ----------------------------------  ----
    ====================================================================================================
    2025-12-15 16:31:02 - evalscope - INFO: 
    Edit_dist:
    --------------------------------  --------
    ALL                               0.719257
    colorful_backgroud                0.591262
    data_source: PPT2PDF              0.513313
    data_source: academic_literature  0.884106
    data_source: book                 0.71472
    data_source: colorful_textbook    0.51466
    data_source: exam_paper           0.632627
    data_source: magazine             0.698865
    data_source: newspaper            0.680857
    data_source: note                 0.542551
    data_source: research_report      0.822244
    fuzzy_scan                        0.396296
    language: en_ch_mixed             0.642029
    language: english                 0.744304
    language: simplified_chinese      0.714089
    layout: 1andmore_column           0.783869
    layout: double_column             0.659029
    layout: other_layout              0.714323
    layout: single_column             0.711999
    layout: three_column              0.749327
    watermark                         0.682397
    --------------------------------  --------
    ====================================================================================================
    2025-12-15 16:31:02 - evalscope - INFO: 
    TEDS:
    --------------------------------  --------
    ALL                               0.351969
    colorful_backgroud                0.459926
    data_source: PPT2PDF              0.543199
    data_source: academic_literature  0.150997
    data_source: book                 0.337622
    data_source: colorful_textbook    0.607402
    data_source: exam_paper           0.523283
    data_source: magazine             0.219568
    data_source: newspaper            0.524607
    data_source: note                 0.513226
    data_source: research_report      0.219692
    fuzzy_scan                        0.641426
    language: en_ch_mixed             0.422374
    language: english                 0.3117
    language: simplified_chinese      0.364083
    layout: 1andmore_column           0.278882
    layout: double_column             0.528474
    layout: other_layout              0.387548
    layout: single_column             0.335139
    layout: three_column              0.424583
    watermark                         0.470567
    --------------------------------  --------
    ====================================================================================================
    2025-12-15 16:31:02 - evalscope - INFO: 
    TEDS_structure_only:
    --------------------------------  --------
    ALL                               0.379422
    colorful_backgroud                0.49911
    data_source: PPT2PDF              0.581095
    data_source: academic_literature  0.170902
    data_source: book                 0.358455
    data_source: colorful_textbook    0.629757
    data_source: exam_paper           0.548585
    data_source: magazine             0.36
    data_source: newspaper            0.624197
    data_source: note                 0.576101
    data_source: research_report      0.230056
    fuzzy_scan                        0.663611
    language: en_ch_mixed             0.447702
    language: english                 0.336284
    language: simplified_chinese      0.392904
    layout: 1andmore_column           0.303873
    layout: double_column             0.561157
    layout: other_layout              0.442395
    layout: single_column             0.357566
    layout: three_column              0.48
    watermark                         0.476504
    --------------------------------  --------
    ====================================================================================================
    2025-12-15 16:31:02 - evalscope - INFO: reading_order
    2025-12-15 16:31:02 - evalscope - INFO: 
    Edit_dist:
    ------------  -------
    ALL_page_avg  0.12521
    ------------  -------
    ====================================================================================================
    2025-12-15 16:31:02 - evalscope - INFO: ----Anno Attribute---------------
    2025-12-15 16:31:02 - evalscope - INFO: 
    sample_count:
    
    ====================================================================================================
    2025-12-15 16:31:02 - evalscope - INFO: 
    Edit_dist:
    --------------------------------  ---------
    ALL                               0.12521
    None                              0.0801312
    colorful_backgroud                0.0776605
    data_source: PPT2PDF              0.0292539
    data_source: academic_literature  0.0641312
    data_source: book                 0.0854695
    data_source: colorful_textbook    0.092139
    data_source: exam_paper           0.114631
    data_source: magazine             0.092494
    data_source: newspaper            0.508178
    data_source: note                 0.0784174
    data_source: research_report      0.0205381
    fuzzy_scan                        0.0980867
    language: en_ch_mixed             0.121147
    language: english                 0.0851486
    language: simplified_chinese      0.145164
    layout: 1andmore_column           0.0750547
    layout: double_column             0.108414
    layout: other_layout              0.316838
    layout: single_column             0.0460209
    layout: three_column              0.173043
    watermark                         0.121829
    --------------------------------  ---------
    ====================================================================================================
    Evaluating [omni_doc_bench]: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1/1 [11:21<00:00, 681.44s/subset]
    2025-12-15 16:31:02 - evalscope - INFO: Generating report...
    2025-12-15 16:31:02 - evalscope - INFO: 
    omni_doc_bench report table:
    +-------------------------------+----------------+------------------------------+----------+-------+---------+---------+
    | Model                         | Dataset        | Metric                       | Subset   |   Num |   Score | Cat.0   |
    +===============================+================+==============================+==========+=======+=========+=========+
    | Qwen3-VL-30B-A3B-Instruct-FP8 | omni_doc_bench | text_block_Edit_dist_EN      | default  |  4905 |  0.0856 | default |
    +-------------------------------+----------------+------------------------------+----------+-------+---------+---------+
    | Qwen3-VL-30B-A3B-Instruct-FP8 | omni_doc_bench | text_block_Edit_dist_CH      | default  |  4905 |  0.218  | default |
    +-------------------------------+----------------+------------------------------+----------+-------+---------+---------+
    | Qwen3-VL-30B-A3B-Instruct-FP8 | omni_doc_bench | display_formula_Edit_dist_EN | default  |  4905 |  0.3531 | default |
    +-------------------------------+----------------+------------------------------+----------+-------+---------+---------+
    | Qwen3-VL-30B-A3B-Instruct-FP8 | omni_doc_bench | display_formula_Edit_dist_CH | default  |  4905 |  0.4387 | default |
    +-------------------------------+----------------+------------------------------+----------+-------+---------+---------+
    | Qwen3-VL-30B-A3B-Instruct-FP8 | omni_doc_bench | table_TEDS_EN                | default  |  4905 |  0.3117 | default |
    +-------------------------------+----------------+------------------------------+----------+-------+---------+---------+
    | Qwen3-VL-30B-A3B-Instruct-FP8 | omni_doc_bench | table_TEDS_CH                | default  |  4905 |  0.3641 | default |
    +-------------------------------+----------------+------------------------------+----------+-------+---------+---------+
    | Qwen3-VL-30B-A3B-Instruct-FP8 | omni_doc_bench | table_Edit_dist_EN           | default  |  4905 |  0.7443 | default |
    +-------------------------------+----------------+------------------------------+----------+-------+---------+---------+
    | Qwen3-VL-30B-A3B-Instruct-FP8 | omni_doc_bench | table_Edit_dist_CH           | default  |  4905 |  0.7141 | default |
    +-------------------------------+----------------+------------------------------+----------+-------+---------+---------+
    | Qwen3-VL-30B-A3B-Instruct-FP8 | omni_doc_bench | reading_order_Edit_dist_EN   | default  |  4905 |  0.0851 | default |
    +-------------------------------+----------------+------------------------------+----------+-------+---------+---------+
    | Qwen3-VL-30B-A3B-Instruct-FP8 | omni_doc_bench | reading_order_Edit_dist_CH   | default  |  4905 |  0.1452 | default |
    +-------------------------------+----------------+------------------------------+----------+-------+---------+---------+
    | Qwen3-VL-30B-A3B-Instruct-FP8 | omni_doc_bench | overall_EN                   | default  |  4905 |  0.317  | default |
    +-------------------------------+----------------+------------------------------+----------+-------+---------+---------+
    | Qwen3-VL-30B-A3B-Instruct-FP8 | omni_doc_bench | overall_CH                   | default  |  4905 |  0.379  | default |
    +-------------------------------+----------------+------------------------------+----------+-------+---------+---------+ 
    
    2025-12-15 16:31:02 - evalscope - INFO: Skipping report analysis (`analysis_report=False`).
    2025-12-15 16:31:02 - evalscope - INFO: Dump report to: outputs/20251215_112047/reports/Qwen3-VL-30B-A3B-Instruct-FP8/omni_doc_bench.json 
    
    2025-12-15 16:31:02 - evalscope - INFO: Benchmark omni_doc_bench evaluation finished.
    2025-12-15 16:31:02 - evalscope - INFO: Overall report table: 
    +-------------------------------+----------------+------------------------------+----------+-------+---------+---------+
    | Model                         | Dataset        | Metric                       | Subset   |   Num |   Score | Cat.0   |
    +===============================+================+==============================+==========+=======+=========+=========+
    | Qwen3-VL-30B-A3B-Instruct-FP8 | omni_doc_bench | text_block_Edit_dist_EN      | default  |  4905 |  0.0856 | default |
    +-------------------------------+----------------+------------------------------+----------+-------+---------+---------+
    | Qwen3-VL-30B-A3B-Instruct-FP8 | omni_doc_bench | text_block_Edit_dist_CH      | default  |  4905 |  0.218  | default |
    +-------------------------------+----------------+------------------------------+----------+-------+---------+---------+
    | Qwen3-VL-30B-A3B-Instruct-FP8 | omni_doc_bench | display_formula_Edit_dist_EN | default  |  4905 |  0.3531 | default |
    +-------------------------------+----------------+------------------------------+----------+-------+---------+---------+
    | Qwen3-VL-30B-A3B-Instruct-FP8 | omni_doc_bench | display_formula_Edit_dist_CH | default  |  4905 |  0.4387 | default |
    +-------------------------------+----------------+------------------------------+----------+-------+---------+---------+
    | Qwen3-VL-30B-A3B-Instruct-FP8 | omni_doc_bench | table_TEDS_EN                | default  |  4905 |  0.3117 | default |
    +-------------------------------+----------------+------------------------------+----------+-------+---------+---------+
    | Qwen3-VL-30B-A3B-Instruct-FP8 | omni_doc_bench | table_TEDS_CH                | default  |  4905 |  0.3641 | default |
    +-------------------------------+----------------+------------------------------+----------+-------+---------+---------+
    | Qwen3-VL-30B-A3B-Instruct-FP8 | omni_doc_bench | table_Edit_dist_EN           | default  |  4905 |  0.7443 | default |
    +-------------------------------+----------------+------------------------------+----------+-------+---------+---------+
    | Qwen3-VL-30B-A3B-Instruct-FP8 | omni_doc_bench | table_Edit_dist_CH           | default  |  4905 |  0.7141 | default |
    +-------------------------------+----------------+------------------------------+----------+-------+---------+---------+
    | Qwen3-VL-30B-A3B-Instruct-FP8 | omni_doc_bench | reading_order_Edit_dist_EN   | default  |  4905 |  0.0851 | default |
    +-------------------------------+----------------+------------------------------+----------+-------+---------+---------+
    | Qwen3-VL-30B-A3B-Instruct-FP8 | omni_doc_bench | reading_order_Edit_dist_CH   | default  |  4905 |  0.1452 | default |
    +-------------------------------+----------------+------------------------------+----------+-------+---------+---------+
    | Qwen3-VL-30B-A3B-Instruct-FP8 | omni_doc_bench | overall_EN                   | default  |  4905 |  0.317  | default |
    +-------------------------------+----------------+------------------------------+----------+-------+---------+---------+
    | Qwen3-VL-30B-A3B-Instruct-FP8 | omni_doc_bench | overall_CH                   | default  |  4905 |  0.379  | default |
    +-------------------------------+----------------+------------------------------+----------+-------+---------+---------+ 
    
    2025-12-15 16:31:03 - evalscope - INFO: Finished evaluation for Qwen3-VL-30B-A3B-Instruct-FP8 on ['omni_doc_bench']
    2025-12-15 16:31:03 - evalscope - INFO: Output directory: outputs/20251215_112047

</details>


## 运行环境

- 操作系统：ubuntu-22.04
- Python版本：python-3.10

## 其他信息

如果有其他相关信息，请在此处提供。


- 上面截图里红色部分，明显异常
- 还缺失display_formula-CDM_plain指标，看evalscope/benchmarks/omnidoc_bench/omnidoc_bench_adapter.py没有支持

1. 红色部分有什么问题呢
2. CDM指标计算比较复杂，暂不支持

- 下面evalscope红色部分结果，和官方差距太大，可能存在一些问题

我这边测了一下，差距不大，你测试的是30B的FP8模型，效果可能略低一点：

<img width="2012" height="788" alt="Image" src="https://github.com/user-attachments/assets/4bab663a-cc96-4f9d-8e8a-f92dff41141a" />