Repository: modelscope/evalscope
Issue: 使用vllm部署以后，使用evalscope评估经常出现retrying
Root cause: Configuration Error

## 自查清单

在提交 issue 之前，请确保您已完成以下步骤:
- [x] 我已仔细阅读了[相关使用说明文档](https://evalscope.readthedocs.io/zh-cn/latest/get_started/parameters.html)
- [x] 我已查看了[常见问题解答](https://evalscope.readthedocs.io/zh-cn/latest/get_started/faq.html)
- [x] 我已搜索并查看了现有的 issues，确认这不是一个重复的问题

## 问题描述

使用vllm部署以后，使用evalscope评估经常出现retrying，时间久了直接把评估任务给结束。
```
redicting(default):  18%|██████████████████▎                                                                                     | 1675/9536 [10:13<1:47:25,  1.22it/s]2025-08-19 06:32:01,043 - openai._base_client - INFO - Retrying request to /chat/completions in 0.420072 seconds
Predicting(default):  18%|██████████████████▌                                                                                     | 1707/9536 [10:42<1:39:42,  1.31it/s]2025-08-19 06:32:29,809 - openai._base_client - INFO - Retrying request to /chat/completions in 0.496874 seconds
Predicting(default):  18%|██████████████████▊                                                                                     | 1721/9536 [10:49<1:01:34,  2.12it/s]2025-08-19 06:32:36,538 - openai._base_client - INFO - Retrying request to /chat/completions in 0.465621 seconds
Predicting(default):  18%|███████████████████▏                                                                                      | 1726/9536 [10:50<26:10,  4.97it/s]2025-08-19 06:32:37,725 - openai._base_client - INFO - Retrying request to /chat/completions in 0.472099 seconds
Predicting(default):  19%|███████████████████▋                                                                                    | 1809/9536 [11:28<1:32:39,  1.39it/s]2025-08-19 06:33:15,598 - openai._base_client - INFO - Retrying request to /chat/completions in 0.407941 seconds
Predicting(default):  20%|█████████████████████                                                                                   | 1936/9536 [12:35<1:02:12,  2.04it/s]2025-08-19 06:34:22,716 - openai._base_client - INFO - Retrying request to /chat/completions in 0.415413 seconds
Predicting(default):  22%|███████████████████████▎                                                                                | 2143/9536 [14:26<1:19:46,  1.54it/s]2025-08-19 06:36:13,599 - openai._base_client - INFO - Retrying request to /chat/completions in 0.388478 seconds
Predicting(default):  25%|█████████████████████████▊                                                                              | 2364/9536 [16:01<3:29:50,  1.76s/it]2025-08-19 06:37:49,078 - openai._base_client - INFO - Retrying request to /chat/completions in 0.489133 seconds
Predicting(default):  25%|█████████████████████████▉                                                                              | 2375/9536 [16:12<1:29:22,  1.34it/s]2025-08-19 06:37:59,667 - openai._base_client - INFO - Retrying request to /chat/completions in 0.447260 seconds
Predicting(default):  26%|██████████████████████████▊                                                                             | 2457/9536 [16:44<1:48:36,  1.09it/s]2025-08-19 06:38:32,741 - openai._base_client - INFO - Retrying request to /chat/completions in 0.496275 seconds
Predicting(default):  29%|███████████████████████████████▏                                                                          | 2810/9536 [19:22<32:32,  3.44it/s]2025-08-19 06:41:10,399 - openai._base_client - INFO - Retrying request to /chat/completions in 0.472670 seconds
Predicting(default):  31%|████████████████████████████████▌                                                                         | 2924/9536 [20:42<37:00,  2.98it/s]2025-08-19 06:42:30,410 - openai._base_client - INFO - Retrying request to /chat/completions in 0.873661 seconds
Predicting(default):  31%|█████████████████████████████████▎                                                                        | 2993/9536 [21:15<57:34,  1.89it/s]2025-08-19 06:43:03,461 - openai._base_client - INFO - Retrying request to /chat/completions in 0.496683 seconds
Predicting(default):  32%|████████████████████████████████▊                                                                       | 3006/9536 [21:34<2:47:19,  1.54s/it]2025-08-19 06:43:21,819 - openai._base_client - INFO - Retrying request to /chat/completions in 0.475145 seconds
Predicting(default):  32%|██████████████████████████████████▏                                                                       | 3080/9536 [22:36<53:19,  2.02it/s]2025-08-19 06:44:23,233 - openai._base_client - INFO - Retrying request to /chat/completions in 0.837529 seconds
Predicting(default):  33%|██████████████████████████████████▊                                                                       | 3137/9536 [23:06<38:35,  2.76it/s]2025-08-19 06:44:54,210 - openai._base_client - INFO - Retrying request to /chat/completions in 0.431882 seconds
```

## EvalScope 版本（必填）
v0.17.1

## 使用的工具
- [x] Native / 原生框架
- [ ] Opencompass backend
- [ ] VLMEvalKit backend
- [ ] RAGEval backend
- [ ] Perf / 模型推理压测工具
- [ ] Arena / 竞技场模式

## 执行的代码或指令

请提供您执行的主要代码或指令。

## 错误日志

请粘贴完整的错误日志或控制台输出。

## 运行环境

- 操作系统：
- Python版本：3.10

## 其他信息

如果有其他相关信息，请在此处提供。


评测时的请求并发是不是太大了，导致vllm处理不过来

> 评测时的请求并发是不是太大了，导致vllm处理不过来

尝试了`--eval-batch-size`设置为4或者保持8，也会报错。

可能是vllm的原因

请问是怎么解决的

分享一下我的经验，可以加一段代码

# ---------- 等服务起好（简单粗暴版） ----------
# 等待接口可用
echo "waiting vLLM ready..."
until curl -s http://localhost:8801/v1/models >/dev/null 2>&1; do
  sleep 10
  echo "still waiting..."
done
echo "vLLM is ready, now start evalscope"

等vllm真的启动以后，再开始eval