Repository: modelscope/evalscope
Issue: gpt-oss-20b eval math_500 error Unexpected token
Root cause: External Dependency Breakage

## Self-Check List

Before submitting an issue, please ensure you have completed the following steps:
- [x] I have carefully read the [relevant user documentation](https://evalscope.readthedocs.io/en/latest/get_started/parameters.html)
- [x] I have reviewed the [Frequently Asked Questions](https://evalscope.readthedocs.io/en/latest/get_started/faq.html)
- [x] I have searched and reviewed existing issues to confirm this is not a duplicate problem

## Problem Description

Please briefly describe the problem you encountered.

When I evaluated the gpt-oss-20b model, math_500 reported an error


## EvalScope Version (Required)
v0.14.0

## Tools Used
- [x] Native / Native framework
- [ ] Opencompass backend
- [ ] VLMEvalKit backend
- [ ] RAGEval backend
- [ ] Perf / Model inference stress testing tool
- [ ] Arena / Arena mode

## Executed Code or Instructions

Please provide the main code or instructions you executed.

### code of starting llm
```bash
CUDA_VISIBLE_DEVICES=6 vllm serve /data/models/openai-mirror/gpt-oss-20b \
    --served-model-name gpt-oss-20b \
    --tensor-parallel-size 1 \
    --trust-remote-code \
    --enable-chunked-prefill \
    --host 0.0.0.0 \
    --port xxx
```
### eval code
```python
from evalscope import TaskConfig, run_task
from evalscope.constants import EvalType

task_cfg = TaskConfig(
    model='gpt-oss-20b',  
    api_url='http://xxx:xxx/v1',  
    api_key='EMPTY',
    eval_type=EvalType.SERVICE,  
    datasets=[
        'math_500',  
    ],
    dataset_args={
        'math_500': {
            'few_shot_num': 0, 'subset_list': ['Level 1', 'Level 2', 'Level 3', 'Level 4', 'Level 5']  
        }
    },
    eval_batch_size=20,       
    generation_config={      
        'max_tokens': 20000,  
        'temperature': 0.6,   
        'top_p': 0.95,       
        'n': 1              
    },
    stream=True               
)

run_task(task_cfg=task_cfg)
```


## Error Log

Please paste the complete error log or console output.
The math_500 error I reported when evaluating the gpt-oss-20b model is as follows
```bash
Reviewing(Level 3): 100%|██████████| 105/105 [00:00<00:00, 302.07it/s]
Predicting(Level 4): 100%|██████████| 128/128 [03:09<00:00,  1.48s/it]
2025-08-15 16:00:07,671 - evalscope - INFO - Dump predictions to ./outputs/20250815_155321/predictions/gpt-oss-20b/math_500_Level 4.jsonl.
Reviewing(Level 4): 100%|██████████| 128/128 [00:00<00:00, 323.45it/s]
Predicting(Level 5):  40%|███▉      | 53/134 [01:28<02:12,  1.63s/it]2025-08-15 16:01:37,103 - evalscope - ERROR - Error when calling remote API: Unexpected token 350 while expecting start token 200006
Predicting(Level 5):  40%|███▉      | 53/134 [05:33<08:29,  6.30s/it]
Traceback (most recent call last):
  File "/data/xxx/evalscope/math_500_test/run_gpt-oss-20b.py", line 27, in <module>
    run_task(task_cfg=task_cfg)
  File "/home/xxx/evalscope/evalscope/run.py", line 31, in run_task
    return run_single_task(task_cfg, run_time)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/xxx/evalscope/evalscope/run.py", line 44, in run_single_task
    result = evaluate_model(task_cfg, outputs)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/xxx/evalscope/evalscope/run.py", line 126, in evaluate_model
    res_dict = evaluator.eval()
               ^^^^^^^^^^^^^^^^
  File "/home/xxx/evalscope/evalscope/evaluator/evaluator.py", line 409, in eval
    answers_list: list = self.get_answers(
                         ^^^^^^^^^^^^^^^^^
  File "/home/xxx/evalscope/evalscope/evaluator/evaluator.py", line 175, in get_answers
    answer_ds: List[dict] = future.result()
                            ^^^^^^^^^^^^^^^
  File "/usr/python/lib/python3.11/concurrent/futures/_base.py", line 449, in result
    return self.__get_result()
           ^^^^^^^^^^^^^^^^^^^
  File "/usr/python/lib/python3.11/concurrent/futures/_base.py", line 401, in __get_result
    raise self._exception
  File "/usr/python/lib/python3.11/concurrent/futures/thread.py", line 58, in run
    result = self.fn(*self.args, **self.kwargs)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/xxx/evalscope/evalscope/evaluator/evaluator.py", line 106, in _get_answer
    answer_ds: List[dict] = self.model_adapter.predict(inputs=input_prompts, infer_cfg=infer_cfg)
                            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/xxx/evalscope/evalscope/models/server_adapter.py", line 63, in predict
    response = self.process_single_input(input_item, infer_cfg)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/xxx/evalscope/evalscope/models/server_adapter.py", line 80, in process_single_input
    response = self.send_request(request_json)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/xxx/evalscope/evalscope/models/server_adapter.py", line 137, in send_request
    response = self._collect_stream_response(response)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/xxx/evalscope/evalscope/models/server_adapter.py", line 149, in _collect_stream_response
    for chunk in response_stream:
  File "/usr/python/lib/python3.11/site-packages/openai/_streaming.py", line 46, in __iter__
    for item in self._iterator:
  File "/usr/python/lib/python3.11/site-packages/openai/_streaming.py", line 72, in __stream__
    raise APIError(
openai.APIError: Unexpected token 350 while expecting start token 200006
```

## Running Environment

- Operating System: Centos7
- Python Version: 3.11.10 

## Additional Information

If there is any other relevant information, please provide it here.


去掉 `stream=True` 能够评测成功吗

> 感谢你的反馈！我们将关闭此问题。如果您有任何疑问，请随时重新打开它。如果EvalScope对您有所帮助，欢迎给我们点个STAR以示支持，谢谢！