Repository: modelscope/evalscope
Issue: 性能测试开启流式--stream时卡住，无法结束
Root cause: Resource Mishandling

## 问题描述 / Issue Description

性能测试开启流式--stream时卡住，无法结束

## 使用的工具 / Tools Used
- [*] Perf / 模型推理压测工具


## 执行的代码或指令 / Code or Commands Executed

```bash
# 例如：在终端中执行的指令 / Terminal command executed
evalscope perf --url 'http://127.0.0.1:8008/v1/chat/completions' --parallel 10 --model 'gpt-3.5-turbo' --log-every-n-query 10 --read-timeout=120 --dataset-path './eval_data/open_qa.jsonl' -n 100 --max-prompt-length 8000 --api openai --dataset openqa --stream
```

## 错误日志 / Error Log

没有报错
![image](https://github.com/user-attachments/assets/6047c890-c9a6-4408-ad74-88f8547ef316)



## 运行环境 / Runtime Environment

- 操作系统 / Operating System:
  - [ ] Windows
  - [ ] macOS
  - [-] Ubuntu

- Python版本 / Python Version:
  - [ ] 3.11
  - [-] 3.10
  - [ ] 3.9


## 其他信息 / Additional Information

evalscope                         0.6.0

目前代码在重构，请尝试使用如下代码安装库，并使用

pip install git+https://github.com/modelscope/evalscope.git@feat/perf


> 目前代码在重构，请尝试使用如下代码安装库，并使用
> 
> pip install git+https://github.com/modelscope/evalscope.git@feat/perf

使用这个版本会报错：
```
2024-11-13 14:56:12,395 - evalscope - ERROR - Exception in async function 'statistic_benchmark_metric_worker': 'object'
Traceback (most recent call last):
  File "/home/wuchen/anaconda3/envs/llama-factory/lib/python3.10/site-packages/evalscope/perf/utils/exception_handler.py", line 16, in async_wrapper
    return await func(*args, **kwargs)
  File "/home/wuchen/anaconda3/envs/llama-factory/lib/python3.10/site-packages/evalscope/perf/benchmark.py", line 165, in statistic_benchmark_metric_worker
    metrics.update_metrics(benchmark_data, api_plugin)
  File "/home/wuchen/anaconda3/envs/llama-factory/lib/python3.10/site-packages/evalscope/perf/utils/benchmark_util.py", line 78, in update_metrics
    benchmark_data._calculate_tokens(api_plugin)
  File "/home/wuchen/anaconda3/envs/llama-factory/lib/python3.10/site-packages/evalscope/perf/utils/benchmark_util.py", line 41, in _calculate_tokens
    api_plugin.parse_responses(self.response_messages, request=self.request)
  File "/home/wuchen/anaconda3/envs/llama-factory/lib/python3.10/site-packages/evalscope/perf/plugin/api/openai_api.py", line 114, in parse_responses
    if js['object'] == 'chat.completion':
KeyError: 'object'
```

请添加--debug参数，输出一下请求参数和内容
    

> 请添加--debug参数，输出一下请求参数和内容

运行日志如下（错误在最后）：

```bash
2024-11-14 11:43:25,567 - datasets - INFO - PyTorch version 2.4.0 available.
2024-11-14 11:43:25,668 - evalscope - INFO - Starting benchmark...
2024-11-14 11:43:25,668 - evalscope - INFO - {
    "model": "gpt-3.5-turbo",
    "api": "openai",
    "tokenizer_path": null,
    "url": "http://127.0.0.1:8008/v1/chat/completions",
    "headers": {
        "Authorization": "Bearer EMPTY"
    },
    "connect_timeout": 120,
    "read_timeout": 120,
    "api_key": "EMPTY",
    "number": 100,
    "parallel": 10,
    "rate": -1,
    "log_every_n_query": 10,
    "debug": true,
    "wandb_api_key": null,
    "name": null,
    "max_prompt_length": 8000,
    "min_prompt_length": 0,
    "prompt": null,
    "query_template": null,
    "dataset": "openqa",
    "dataset_path": "./eval_data/open_qa.jsonl",
    "frequency_penalty": null,
    "logprobs": null,
    "max_tokens": 2048,
    "n_choices": null,
    "seed": null,
    "stop": null,
    "stop_token_ids": null,
    "stream": true,
    "temperature": null,
    "top_p": null
}
2024-11-14 11:43:25,668 - evalscope - http_client.py - on_request_start - 113 - DEBUG - Starting request: <TraceRequestStartParams(method='POST', url=URL('http://127.0.0.1:8008/v1/chat/completions'), headers=<CIMultiDict('Content-Type': 'application/json', 'user-agent': 'modelscope_bench', 'Authorization': 'Bearer EMPTY')>)>
2024-11-14 11:43:25,669 - evalscope - http_client.py - on_request_chunk_sent - 120 - DEBUG - Request sent: <method='POST',  url=URL('http://127.0.0.1:8008/v1/chat/completions'), chunk='{"messages": [{"role": "user", "content": "hello"}], "model": "gpt-3.5-turbo"}'>
2024-11-14 11:43:25,925 - evalscope - http_client.py - on_response_chunk_received - 127 - DEBUG - Response recevied: <method='POST',  url=URL('http://127.0.0.1:8008/v1/chat/completions'), chunk='{"id":"chatcmpl-960c58d2e150411abd4b96509a6b643c","object":"chat.completion","created":1731555805,"model":"gpt-3.5-turbo","choices":[{"index":0,"message":{"role":"assistant","content":"Hello there! How can I assist you today?","tool_calls":null},"finish_reason":"stop"}],"usage":{"prompt_tokens":20,"completion_tokens":11,"total_tokens":31}}'>
2024-11-14 11:43:25,926 - evalscope - benchmark.py - test_connection - 201 - INFO - Connection successful.
2024-11-14 11:43:25,927 - evalscope - db_utils.py - get_result_db_path - 68 - INFO - Save the result to: ./outputs/gpt-3.5-turbo_benchmark_20241114_114325.db

Processing: 0it [00:00, ?it/s]2024-11-14 11:43:25,953 - evalscope - http_client.py - on_request_start - 113 - DEBUG - Starting request: <TraceRequestStartParams(method='POST', url=URL('http://127.0.0.1:8008/v1/chat/completions'), headers=<CIMultiDict('Content-Type': 'application/json', 'user-agent': 'modelscope_bench', 'Authorization': 'Bearer EMPTY')>)>
2024-11-14 11:43:25,953 - evalscope - http_client.py - on_request_start - 113 - DEBUG - Starting request: <TraceRequestStartParams(method='POST', url=URL('http://127.0.0.1:8008/v1/chat/completions'), headers=<CIMultiDict('Content-Type': 'application/json', 'user-agent': 'modelscope_bench', 'Authorization': 'Bearer EMPTY')>)>
2024-11-14 11:43:25,954 - evalscope - http_client.py - on_request_start - 113 - DEBUG - Starting request: <TraceRequestStartParams(method='POST', url=URL('http://127.0.0.1:8008/v1/chat/completions'), headers=<CIMultiDict('Content-Type': 'application/json', 'user-agent': 'modelscope_bench', 'Authorization': 'Bearer EMPTY')>)>
2024-11-14 11:43:25,954 - evalscope - http_client.py - on_request_start - 113 - DEBUG - Starting request: <TraceRequestStartParams(method='POST', url=URL('http://127.0.0.1:8008/v1/chat/completions'), headers=<CIMultiDict('Content-Type': 'application/json', 'user-agent': 'modelscope_bench', 'Authorization': 'Bearer EMPTY')>)>
2024-11-14 11:43:25,954 - evalscope - http_client.py - on_request_start - 113 - DEBUG - Starting request: <TraceRequestStartParams(method='POST', url=URL('http://127.0.0.1:8008/v1/chat/completions'), headers=<CIMultiDict('Content-Type': 'application/json', 'user-agent': 'modelscope_bench', 'Authorization': 'Bearer EMPTY')>)>
2024-11-14 11:43:25,954 - evalscope - http_client.py - on_request_start - 113 - DEBUG - Starting request: <TraceRequestStartParams(method='POST', url=URL('http://127.0.0.1:8008/v1/chat/completions'), headers=<CIMultiDict('Content-Type': 'application/json', 'user-agent': 'modelscope_bench', 'Authorization': 'Bearer EMPTY')>)>
2024-11-14 11:43:25,955 - evalscope - http_client.py - on_request_start - 113 - DEBUG - Starting request: <TraceRequestStartParams(method='POST', url=URL('http://127.0.0.1:8008/v1/chat/completions'), headers=<CIMultiDict('Content-Type': 'application/json', 'user-agent': 'modelscope_bench', 'Authorization': 'Bearer EMPTY')>)>
2024-11-14 11:43:25,955 - evalscope - http_client.py - on_request_start - 113 - DEBUG - Starting request: <TraceRequestStartParams(method='POST', url=URL('http://127.0.0.1:8008/v1/chat/completions'), headers=<CIMultiDict('Content-Type': 'application/json', 'user-agent': 'modelscope_bench', 'Authorization': 'Bearer EMPTY')>)>
2024-11-14 11:43:25,955 - evalscope - http_client.py - on_request_start - 113 - DEBUG - Starting request: <TraceRequestStartParams(method='POST', url=URL('http://127.0.0.1:8008/v1/chat/completions'), headers=<CIMultiDict('Content-Type': 'application/json', 'user-agent': 'modelscope_bench', 'Authorization': 'Bearer EMPTY')>)>
2024-11-14 11:43:25,956 - evalscope - http_client.py - on_request_start - 113 - DEBUG - Starting request: <TraceRequestStartParams(method='POST', url=URL('http://127.0.0.1:8008/v1/chat/completions'), headers=<CIMultiDict('Content-Type': 'application/json', 'user-agent': 'modelscope_bench', 'Authorization': 'Bearer EMPTY')>)>
2024-11-14 11:43:25,956 - evalscope - http_client.py - on_request_chunk_sent - 120 - DEBUG - Request sent: <method='POST',  url=URL('http://127.0.0.1:8008/v1/chat/completions'), chunk='{"messages": [{"role": "user", "content": "盗贼天赋盗贼怎么加天赋?知道告诉一下下啦~~"}], "model": "gpt-3.5-turbo", "max_tokens": 2048, "stream": true, "stream_options": {"include_usage": true}}'>
2024-11-14 11:43:25,958 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"role": "assistant", "content": ""}, "finish_reason": null}]}
2024-11-14 11:43:25,992 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "您"}, "finish_reason": null}]}
2024-11-14 11:43:26,012 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "可能是"}, "finish_reason": null}]}
2024-11-14 11:43:26,032 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "想"}, "finish_reason": null}]}
2024-11-14 11:43:26,053 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "询问"}, "finish_reason": null}]}
2024-11-14 11:43:26,073 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "在"}, "finish_reason": null}]}
2024-11-14 11:43:26,093 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "某个"}, "finish_reason": null}]}
2024-11-14 11:43:26,113 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "游戏"}, "finish_reason": null}]}
2024-11-14 11:43:26,134 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "（"}, "finish_reason": null}]}
2024-11-14 11:43:26,154 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "如"}, "finish_reason": null}]}
2024-11-14 11:43:26,174 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "魔兽"}, "finish_reason": null}]}
2024-11-14 11:43:26,194 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "世界"}, "finish_reason": null}]}
2024-11-14 11:43:26,214 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "）"}, "finish_reason": null}]}
2024-11-14 11:43:26,235 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "中"}, "finish_reason": null}]}
2024-11-14 11:43:26,255 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "，"}, "finish_reason": null}]}
2024-11-14 11:43:26,275 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "盗"}, "finish_reason": null}]}
2024-11-14 11:43:26,295 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "贼"}, "finish_reason": null}]}
2024-11-14 11:43:26,315 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "职业"}, "finish_reason": null}]}
2024-11-14 11:43:26,336 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "的"}, "finish_reason": null}]}
2024-11-14 11:43:26,356 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "天赋"}, "finish_reason": null}]}
2024-11-14 11:43:26,376 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "加"}, "finish_reason": null}]}
2024-11-14 11:43:26,396 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "点"}, "finish_reason": null}]}
2024-11-14 11:43:26,416 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "方式"}, "finish_reason": null}]}
2024-11-14 11:43:26,437 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "。"}, "finish_reason": null}]}
2024-11-14 11:43:26,457 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "以下"}, "finish_reason": null}]}
2024-11-14 11:43:26,477 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "是一个"}, "finish_reason": null}]}
2024-11-14 11:43:26,497 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "常见的"}, "finish_reason": null}]}
2024-11-14 11:43:26,517 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "魔兽"}, "finish_reason": null}]}
2024-11-14 11:43:26,538 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "世界"}, "finish_reason": null}]}
2024-11-14 11:43:26,558 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "盗"}, "finish_reason": null}]}
2024-11-14 11:43:26,578 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "贼"}, "finish_reason": null}]}
2024-11-14 11:43:26,598 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "天赋"}, "finish_reason": null}]}
2024-11-14 11:43:26,619 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "加"}, "finish_reason": null}]}
2024-11-14 11:43:26,639 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "点"}, "finish_reason": null}]}
2024-11-14 11:43:26,659 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "建议"}, "finish_reason": null}]}
2024-11-14 11:43:26,679 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "，"}, "finish_reason": null}]}
2024-11-14 11:43:26,699 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "但"}, "finish_reason": null}]}
2024-11-14 11:43:26,720 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "请注意"}, "finish_reason": null}]}
2024-11-14 11:43:26,740 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "，"}, "finish_reason": null}]}
2024-11-14 11:43:26,760 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "根据"}, "finish_reason": null}]}
2024-11-14 11:43:26,780 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "您的"}, "finish_reason": null}]}
2024-11-14 11:43:26,801 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "游戏"}, "finish_reason": null}]}
2024-11-14 11:43:26,821 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "版本"}, "finish_reason": null}]}
2024-11-14 11:43:26,841 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "和个人"}, "finish_reason": null}]}
2024-11-14 11:43:26,861 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "喜好"}, "finish_reason": null}]}
2024-11-14 11:43:26,881 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "，"}, "finish_reason": null}]}
2024-11-14 11:43:26,901 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "加"}, "finish_reason": null}]}
2024-11-14 11:43:26,922 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "点"}, "finish_reason": null}]}
2024-11-14 11:43:26,942 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "方式"}, "finish_reason": null}]}
2024-11-14 11:43:26,962 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "可能会"}, "finish_reason": null}]}
2024-11-14 11:43:26,982 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "有所不同"}, "finish_reason": null}]}
2024-11-14 11:43:27,002 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "。\n\n"}, "finish_reason": null}]}
2024-11-14 11:43:27,022 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "1"}, "finish_reason": null}]}
2024-11-14 11:43:27,042 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "."}, "finish_reason": null}]}
2024-11-14 11:43:27,103 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": " 毒"}, "finish_reason": null}]}
2024-11-14 11:43:27,124 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "药"}, "finish_reason": null}]}
2024-11-14 11:43:27,144 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "大师"}, "finish_reason": null}]}
2024-11-14 11:43:27,164 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "："}, "finish_reason": null}]}
2024-11-14 11:43:27,184 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "毒"}, "finish_reason": null}]}
2024-11-14 11:43:27,205 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "药"}, "finish_reason": null}]}
2024-11-14 11:43:27,225 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "大师"}, "finish_reason": null}]}
2024-11-14 11:43:27,245 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "是一个"}, "finish_reason": null}]}
2024-11-14 11:43:27,267 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "非常"}, "finish_reason": null}]}
2024-11-14 11:43:27,287 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "重要的"}, "finish_reason": null}]}
2024-11-14 11:43:27,307 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "天赋"}, "finish_reason": null}]}
2024-11-14 11:43:27,327 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "，"}, "finish_reason": null}]}
2024-11-14 11:43:27,348 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "可以"}, "finish_reason": null}]}
2024-11-14 11:43:27,368 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "提高"}, "finish_reason": null}]}
2024-11-14 11:43:27,388 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "毒"}, "finish_reason": null}]}
2024-11-14 11:43:27,410 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "药"}, "finish_reason": null}]}
2024-11-14 11:43:27,432 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "的效果"}, "finish_reason": null}]}
2024-11-14 11:43:27,452 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "。"}, "finish_reason": null}]}
2024-11-14 11:43:27,474 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "毒"}, "finish_reason": null}]}
2024-11-14 11:43:27,495 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "药"}, "finish_reason": null}]}
2024-11-14 11:43:27,516 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "对于"}, "finish_reason": null}]}
2024-11-14 11:43:27,536 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "P"}, "finish_reason": null}]}
2024-11-14 11:43:27,556 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "VP"}, "finish_reason": null}]}
2024-11-14 11:43:27,577 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "和"}, "finish_reason": null}]}
2024-11-14 11:43:27,600 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "P"}, "finish_reason": null}]}
2024-11-14 11:43:27,620 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "VE"}, "finish_reason": null}]}
2024-11-14 11:43:27,641 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "都是非常"}, "finish_reason": null}]}
2024-11-14 11:43:27,661 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "有用的"}, "finish_reason": null}]}
2024-11-14 11:43:27,682 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "。\n"}, "finish_reason": null}]}
2024-11-14 11:43:27,702 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "2"}, "finish_reason": null}]}
2024-11-14 11:43:27,723 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "."}, "finish_reason": null}]}
2024-11-14 11:43:27,784 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": " 暗"}, "finish_reason": null}]}
2024-11-14 11:43:27,805 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "影"}, "finish_reason": null}]}
2024-11-14 11:43:27,825 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "斗"}, "finish_reason": null}]}
2024-11-14 11:43:27,845 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "篷"}, "finish_reason": null}]}
2024-11-14 11:43:27,866 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "："}, "finish_reason": null}]}
2024-11-14 11:43:27,886 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "暗"}, "finish_reason": null}]}
2024-11-14 11:43:27,907 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "影"}, "finish_reason": null}]}
2024-11-14 11:43:27,927 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "斗"}, "finish_reason": null}]}
2024-11-14 11:43:27,948 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "篷"}, "finish_reason": null}]}
2024-11-14 11:43:27,970 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "是一个"}, "finish_reason": null}]}
2024-11-14 11:43:27,990 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "很好的"}, "finish_reason": null}]}
2024-11-14 11:43:28,011 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "生存"}, "finish_reason": null}]}
2024-11-14 11:43:28,031 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "天赋"}, "finish_reason": null}]}
2024-11-14 11:43:28,052 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "，"}, "finish_reason": null}]}
2024-11-14 11:43:28,072 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "可以"}, "finish_reason": null}]}
2024-11-14 11:43:28,093 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "让你"}, "finish_reason": null}]}
2024-11-14 11:43:28,113 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "在"}, "finish_reason": null}]}
2024-11-14 11:43:28,134 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "战斗"}, "finish_reason": null}]}
2024-11-14 11:43:28,155 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "中"}, "finish_reason": null}]}
2024-11-14 11:43:28,175 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "隐身"}, "finish_reason": null}]}
2024-11-14 11:43:28,196 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "一段时间"}, "finish_reason": null}]}
2024-11-14 11:43:28,217 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "。\n"}, "finish_reason": null}]}
2024-11-14 11:43:28,237 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "3"}, "finish_reason": null}]}
2024-11-14 11:43:28,258 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "."}, "finish_reason": null}]}
2024-11-14 11:43:28,320 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": " 贪"}, "finish_reason": null}]}
2024-11-14 11:43:28,340 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "婪"}, "finish_reason": null}]}
2024-11-14 11:43:28,361 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "："}, "finish_reason": null}]}
2024-11-14 11:43:28,382 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "贪婪"}, "finish_reason": null}]}
2024-11-14 11:43:28,402 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "可以"}, "finish_reason": null}]}
2024-11-14 11:43:28,423 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "让你"}, "finish_reason": null}]}
2024-11-14 11:43:28,444 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "在"}, "finish_reason": null}]}
2024-11-14 11:43:28,465 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "杀死"}, "finish_reason": null}]}
2024-11-14 11:43:28,485 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "怪物"}, "finish_reason": null}]}
2024-11-14 11:43:28,506 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "时"}, "finish_reason": null}]}
2024-11-14 11:43:28,527 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "获得"}, "finish_reason": null}]}
2024-11-14 11:43:28,548 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "更多的"}, "finish_reason": null}]}
2024-11-14 11:43:28,568 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "金币"}, "finish_reason": null}]}
2024-11-14 11:43:28,589 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "。\n"}, "finish_reason": null}]}
2024-11-14 11:43:28,609 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "4"}, "finish_reason": null}]}
2024-11-14 11:43:28,630 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "."}, "finish_reason": null}]}
2024-11-14 11:43:28,691 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": " 暗"}, "finish_reason": null}]}
2024-11-14 11:43:28,712 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "影"}, "finish_reason": null}]}
2024-11-14 11:43:28,732 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "打击"}, "finish_reason": null}]}
2024-11-14 11:43:28,753 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "："}, "finish_reason": null}]}
2024-11-14 11:43:28,774 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "暗"}, "finish_reason": null}]}
2024-11-14 11:43:28,794 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "影"}, "finish_reason": null}]}
2024-11-14 11:43:28,815 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "打击"}, "finish_reason": null}]}
2024-11-14 11:43:28,835 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "可以"}, "finish_reason": null}]}
2024-11-14 11:43:28,856 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "让你"}, "finish_reason": null}]}
2024-11-14 11:43:28,876 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "的"}, "finish_reason": null}]}
2024-11-14 11:43:28,897 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "攻击"}, "finish_reason": null}]}
2024-11-14 11:43:28,917 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "造成"}, "finish_reason": null}]}
2024-11-14 11:43:28,937 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "额外"}, "finish_reason": null}]}
2024-11-14 11:43:28,958 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "的"}, "finish_reason": null}]}
2024-11-14 11:43:28,978 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "暗"}, "finish_reason": null}]}
2024-11-14 11:43:28,999 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "影"}, "finish_reason": null}]}
2024-11-14 11:43:29,019 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "伤害"}, "finish_reason": null}]}
2024-11-14 11:43:29,040 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "，"}, "finish_reason": null}]}
2024-11-14 11:43:29,061 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "这对于"}, "finish_reason": null}]}
2024-11-14 11:43:29,081 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "P"}, "finish_reason": null}]}
2024-11-14 11:43:29,102 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "VE"}, "finish_reason": null}]}
2024-11-14 11:43:29,122 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "和"}, "finish_reason": null}]}
2024-11-14 11:43:29,143 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "P"}, "finish_reason": null}]}
2024-11-14 11:43:29,163 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "VP"}, "finish_reason": null}]}
2024-11-14 11:43:29,184 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "都是非常"}, "finish_reason": null}]}
2024-11-14 11:43:29,205 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "有用的"}, "finish_reason": null}]}
2024-11-14 11:43:29,225 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "。\n"}, "finish_reason": null}]}
2024-11-14 11:43:29,246 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "5"}, "finish_reason": null}]}
2024-11-14 11:43:29,267 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "."}, "finish_reason": null}]}
2024-11-14 11:43:29,328 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": " 毒"}, "finish_reason": null}]}
2024-11-14 11:43:29,349 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "蛇"}, "finish_reason": null}]}
2024-11-14 11:43:29,370 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "钉"}, "finish_reason": null}]}
2024-11-14 11:43:29,390 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "刺"}, "finish_reason": null}]}
2024-11-14 11:43:29,411 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "："}, "finish_reason": null}]}
2024-11-14 11:43:29,431 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "毒"}, "finish_reason": null}]}
2024-11-14 11:43:29,451 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "蛇"}, "finish_reason": null}]}
2024-11-14 11:43:29,472 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "钉"}, "finish_reason": null}]}
2024-11-14 11:43:29,492 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "刺"}, "finish_reason": null}]}
2024-11-14 11:43:29,513 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "可以"}, "finish_reason": null}]}
2024-11-14 11:43:29,533 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "让你"}, "finish_reason": null}]}
2024-11-14 11:43:29,553 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "的"}, "finish_reason": null}]}
2024-11-14 11:43:29,574 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "攻击"}, "finish_reason": null}]}
2024-11-14 11:43:29,594 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "造成"}, "finish_reason": null}]}
2024-11-14 11:43:29,615 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "持续"}, "finish_reason": null}]}
2024-11-14 11:43:29,635 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "的"}, "finish_reason": null}]}
2024-11-14 11:43:29,656 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "毒素"}, "finish_reason": null}]}
2024-11-14 11:43:29,677 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "伤害"}, "finish_reason": null}]}
2024-11-14 11:43:29,699 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "，"}, "finish_reason": null}]}
2024-11-14 11:43:29,719 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "对于"}, "finish_reason": null}]}
2024-11-14 11:43:29,740 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "P"}, "finish_reason": null}]}
2024-11-14 11:43:29,760 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "VE"}, "finish_reason": null}]}
2024-11-14 11:43:29,781 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "和"}, "finish_reason": null}]}
2024-11-14 11:43:29,803 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "P"}, "finish_reason": null}]}
2024-11-14 11:43:29,824 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "VP"}, "finish_reason": null}]}
2024-11-14 11:43:29,844 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "都是非常"}, "finish_reason": null}]}
2024-11-14 11:43:29,865 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "有用的"}, "finish_reason": null}]}
2024-11-14 11:43:29,886 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "。\n"}, "finish_reason": null}]}
2024-11-14 11:43:29,906 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "6"}, "finish_reason": null}]}
2024-11-14 11:43:29,927 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "."}, "finish_reason": null}]}
2024-11-14 11:43:29,988 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": " 毒"}, "finish_reason": null}]}
2024-11-14 11:43:30,009 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "蛇"}, "finish_reason": null}]}
2024-11-14 11:43:30,029 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "守"}, "finish_reason": null}]}
2024-11-14 11:43:30,050 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "卫"}, "finish_reason": null}]}
2024-11-14 11:43:30,071 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "："}, "finish_reason": null}]}
2024-11-14 11:43:30,091 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "毒"}, "finish_reason": null}]}
2024-11-14 11:43:30,112 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "蛇"}, "finish_reason": null}]}
2024-11-14 11:43:30,133 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "守"}, "finish_reason": null}]}
2024-11-14 11:43:30,153 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "卫"}, "finish_reason": null}]}
2024-11-14 11:43:30,174 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "可以"}, "finish_reason": null}]}
2024-11-14 11:43:30,195 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "让你"}, "finish_reason": null}]}
2024-11-14 11:43:30,216 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "在"}, "finish_reason": null}]}
2024-11-14 11:43:30,236 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "被"}, "finish_reason": null}]}
2024-11-14 11:43:30,257 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "攻击"}, "finish_reason": null}]}
2024-11-14 11:43:30,278 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "时"}, "finish_reason": null}]}
2024-11-14 11:43:30,299 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "反击"}, "finish_reason": null}]}
2024-11-14 11:43:30,319 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "敌人"}, "finish_reason": null}]}
2024-11-14 11:43:30,340 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "，"}, "finish_reason": null}]}
2024-11-14 11:43:30,361 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "对于"}, "finish_reason": null}]}
2024-11-14 11:43:30,382 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "生存"}, "finish_reason": null}]}
2024-11-14 11:43:30,402 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "是非常"}, "finish_reason": null}]}
2024-11-14 11:43:30,423 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "有用的"}, "finish_reason": null}]}
2024-11-14 11:43:30,443 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "。\n"}, "finish_reason": null}]}
2024-11-14 11:43:30,464 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "7"}, "finish_reason": null}]}
2024-11-14 11:43:30,485 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "."}, "finish_reason": null}]}
2024-11-14 11:43:30,527 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": " 刀"}, "finish_reason": null}]}
2024-11-14 11:43:30,549 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "锋"}, "finish_reason": null}]}
2024-11-14 11:43:30,569 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "之"}, "finish_reason": null}]}
2024-11-14 11:43:30,590 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "雨"}, "finish_reason": null}]}
2024-11-14 11:43:30,611 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "："}, "finish_reason": null}]}
2024-11-14 11:43:30,631 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "刀"}, "finish_reason": null}]}
2024-11-14 11:43:30,652 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "锋"}, "finish_reason": null}]}
2024-11-14 11:43:30,672 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "之"}, "finish_reason": null}]}
2024-11-14 11:43:30,695 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "雨"}, "finish_reason": null}]}
2024-11-14 11:43:30,717 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "可以"}, "finish_reason": null}]}
2024-11-14 11:43:30,740 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "让你"}, "finish_reason": null}]}
2024-11-14 11:43:30,763 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "在"}, "finish_reason": null}]}
2024-11-14 11:43:30,784 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "短时间内"}, "finish_reason": null}]}
2024-11-14 11:43:30,807 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "对"}, "finish_reason": null}]}
2024-11-14 11:43:30,828 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "多个"}, "finish_reason": null}]}
2024-11-14 11:43:30,849 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "敌人"}, "finish_reason": null}]}
2024-11-14 11:43:30,871 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "造成"}, "finish_reason": null}]}
2024-11-14 11:43:30,892 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "伤害"}, "finish_reason": null}]}
2024-11-14 11:43:30,913 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "，"}, "finish_reason": null}]}
2024-11-14 11:43:30,935 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "对于"}, "finish_reason": null}]}
2024-11-14 11:43:30,956 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "P"}, "finish_reason": null}]}
2024-11-14 11:43:30,977 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "VE"}, "finish_reason": null}]}
2024-11-14 11:43:30,997 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "和"}, "finish_reason": null}]}
2024-11-14 11:43:31,019 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "P"}, "finish_reason": null}]}
2024-11-14 11:43:31,039 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "VP"}, "finish_reason": null}]}
2024-11-14 11:43:31,060 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "都是非常"}, "finish_reason": null}]}
2024-11-14 11:43:31,081 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "有用的"}, "finish_reason": null}]}
2024-11-14 11:43:31,101 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "。\n\n"}, "finish_reason": null}]}
2024-11-14 11:43:31,122 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "这只是"}, "finish_reason": null}]}
2024-11-14 11:43:31,144 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "其中"}, "finish_reason": null}]}
2024-11-14 11:43:31,165 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "一种"}, "finish_reason": null}]}
2024-11-14 11:43:31,185 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "天赋"}, "finish_reason": null}]}
2024-11-14 11:43:31,206 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "加"}, "finish_reason": null}]}
2024-11-14 11:43:31,227 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "点"}, "finish_reason": null}]}
2024-11-14 11:43:31,247 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "方式"}, "finish_reason": null}]}
2024-11-14 11:43:31,268 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "，"}, "finish_reason": null}]}
2024-11-14 11:43:31,288 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "您可以"}, "finish_reason": null}]}
2024-11-14 11:43:31,309 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "根据"}, "finish_reason": null}]}
2024-11-14 11:43:31,330 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "自己的"}, "finish_reason": null}]}
2024-11-14 11:43:31,351 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "游戏"}, "finish_reason": null}]}
2024-11-14 11:43:31,372 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "风格"}, "finish_reason": null}]}
2024-11-14 11:43:31,392 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "和"}, "finish_reason": null}]}
2024-11-14 11:43:31,413 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "喜好"}, "finish_reason": null}]}
2024-11-14 11:43:31,433 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "进行"}, "finish_reason": null}]}
2024-11-14 11:43:31,453 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "调整"}, "finish_reason": null}]}
2024-11-14 11:43:31,476 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "。"}, "finish_reason": null}]}
2024-11-14 11:43:31,498 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "另外"}, "finish_reason": null}]}
2024-11-14 11:43:31,519 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "，"}, "finish_reason": null}]}
2024-11-14 11:43:31,542 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "游戏"}, "finish_reason": null}]}
2024-11-14 11:43:31,563 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "中的"}, "finish_reason": null}]}
2024-11-14 11:43:31,583 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "天赋"}, "finish_reason": null}]}
2024-11-14 11:43:31,604 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "系统"}, "finish_reason": null}]}
2024-11-14 11:43:31,625 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "会"}, "finish_reason": null}]}
2024-11-14 11:43:31,646 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "不断"}, "finish_reason": null}]}
2024-11-14 11:43:31,666 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "更新"}, "finish_reason": null}]}
2024-11-14 11:43:31,687 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "和"}, "finish_reason": null}]}
2024-11-14 11:43:31,708 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "调整"}, "finish_reason": null}]}
2024-11-14 11:43:31,728 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "，"}, "finish_reason": null}]}
2024-11-14 11:43:31,749 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "所以"}, "finish_reason": null}]}
2024-11-14 11:43:31,769 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "请"}, "finish_reason": null}]}
2024-11-14 11:43:31,790 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "根据"}, "finish_reason": null}]}
2024-11-14 11:43:31,812 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "最新的"}, "finish_reason": null}]}
2024-11-14 11:43:31,832 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "游戏"}, "finish_reason": null}]}
2024-11-14 11:43:31,853 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "版本"}, "finish_reason": null}]}
2024-11-14 11:43:31,873 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "进行"}, "finish_reason": null}]}
2024-11-14 11:43:31,893 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "参考"}, "finish_reason": null}]}
2024-11-14 11:43:31,914 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {"content": "。"}, "finish_reason": null}]}
2024-11-14 11:43:31,934 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: {"id": "chatcmpl-0b8749ad0ed04660b0e8d66872107493", "model": "gpt-3.5-turbo", "choices": [{"index": 0, "delta": {}, "finish_reason": "stop"}]}
2024-11-14 11:43:31,934 - evalscope - http_client.py - _handle_stream - 54 - DEBUG - Response recevied: data: [DONE]

Processing: 0it [00:05, ?it/s]
2024-11-14 11:43:31,935 - evalscope - exception_handler.py - async_wrapper - 18 - ERROR - Exception in async function 'statistic_benchmark_metric_worker': 'object'
Traceback (most recent call last):
  File "/home/wuchen/anaconda3/envs/llama-factory/lib/python3.10/site-packages/evalscope/perf/utils/exception_handler.py", line 16, in async_wrapper
    return await func(*args, **kwargs)
  File "/home/wuchen/anaconda3/envs/llama-factory/lib/python3.10/site-packages/evalscope/perf/benchmark.py", line 165, in statistic_benchmark_metric_worker
    metrics.update_metrics(benchmark_data, api_plugin)
  File "/home/wuchen/anaconda3/envs/llama-factory/lib/python3.10/site-packages/evalscope/perf/utils/benchmark_util.py", line 78, in update_metrics
    benchmark_data._calculate_tokens(api_plugin)
  File "/home/wuchen/anaconda3/envs/llama-factory/lib/python3.10/site-packages/evalscope/perf/utils/benchmark_util.py", line 41, in _calculate_tokens
    api_plugin.parse_responses(self.response_messages, request=self.request)
  File "/home/wuchen/anaconda3/envs/llama-factory/lib/python3.10/site-packages/evalscope/perf/plugin/api/openai_api.py", line 114, in parse_responses
    if js['object'] == 'chat.completion':
KeyError: 'object'
```

运行命令及参数：
```bash
evalscope perf --url 'http://127.0.0.1:8008/v1/chat/completions' --parallel 10 --model 'gpt-3.5-turbo' --log-every-n-query 10 --read-timeout=120 --dataset-path './eval_data/open_qa.jsonl' -n 100 --max-prompt-length 8000 --api openai --dataset openqa --stream --debug
```

版本信息：
evalscope                         2.0.0

您使用api看起来不是标准的openai api格式，缺少`object`字段，参考标准格式：https://platform.openai.com/docs/api-reference/chat/streaming

> 您使用api看起来不是标准的openai api格式，缺少`object`字段，参考标准格式：https://platform.openai.com/docs/api-reference/chat/streaming

我把LLama-factory的日志和evalscope的日志作了一下对比，发现evalscope中，object字段不见了，LLama-factory里是有的。
LLama-factory日志截图：
![llama-factory-log](https://github.com/user-attachments/assets/66382354-e2bf-4b5e-9165-126c6968a542)

evalscope日志截图：
![evalscope-log](https://github.com/user-attachments/assets/150dd6b6-0609-446a-b0f4-4b06f1b9d780)


请提供一下部署该模型服务的方法，我们复现一下

使用LLama-factory部署api，模型是qwen2.5-14b。

配置文件如下：
qwen25_14b.yaml
```yaml
model_name_or_path: /home/wuchen/models/Qwen/Qwen2___5-14B-Instruct
template: qwen
infer_backend: vllm
vllm_gpu_util: 0.9
vllm_maxlen: 8000
vllm_enforce_eager: true
```

启动命令：
```bash
VLLM_WORKER_MULTIPROC_METHOD=spawn API_PORT=8008 llamafactory-cli api examples/inference/qwen25_14b.yaml
```

模型下载，使用modelscope：
```bash
modelscope download --model 'Qwen/Qwen2.5-14B-Instruct' --cache_dir './models'
```

好的，也请尝试一下直接使用vllm来启动服务，看看有没有问题：

```bash
export VLLM_USE_MODELSCOPE=True && python -m vllm.entrypoints.openai.api_server --model Qwen/Qwen2.5-14B-Instruct --gpu-memory-utilization 0.8 --served-model-name qwen2.5 
```

> 好的，也请尝试一下直接使用vllm来启动服务，看看有没有问题：
> 
> ```shell
> export VLLM_USE_MODELSCOPE=True && python -m vllm.entrypoints.openai.api_server --model Qwen/Qwen2.5-14B-Instruct --gpu-memory-utilization 0.8 --served-model-name qwen2.5 
> ```

现在使用vllm启动，暂时没有报错，正在运行，看看能不能跑完。

vllm日志截图：
![image](https://github.com/user-attachments/assets/4143757b-3539-4c89-93f6-6ef8a491b393)

evalscope日志截图：
![image](https://github.com/user-attachments/assets/5bb446ea-d103-4fc7-a8e8-df985c9ecf71)


还是报错了，不过这个错误跟evalscope应该没关系了。

![image](https://github.com/user-attachments/assets/be9c93ff-6453-4ad0-8702-ed9348efa597)


我执行了很多次，每次到这里就会报这个Connector is closed. 的错误。执行到测试数据的91条的时候就报错。
@Yunnglin 你能复现这个错误吗？

尝试去掉--parallel参数，使用--rate 1，猜测是qps太高导致一些请求超时了

> 尝试去掉--parallel参数，使用--rate 1，猜测是qps太高导致一些请求超时了

嗯，一个并发就没有报错了。但是想测多个并发就不行。

@Yunnglin 你觉得这是哪里的问题呢？是显存不够大吗？还是什么原因？

rate可以设置更高，但也要设置更大的超时时间，比如time out设置为600，或者更大。

本质是请求太多了，服务器请求不过来，导致一些请求超时了。

rate是每秒的请求数，和并发的区别在哪里呢？是vllm服务端响应不过来了？

parallel是指有几个worker在发送请求

rate是每个worker每秒请求数，默认rate 是-1，表示第0秒发送全部请求

我似乎也遇到了这个问题，但不是因为请求的问题

请拉取最新的main分支代码，安装后尝试重新运行，并添加--debug参数

> 请拉取最新的main分支代码，安装后尝试重新运行，并添加--debug参数

感谢回复，昨晚有尝试过，并没有什么有用的信息，加上 stream 后，再确认正常处理完所有与 openai 接口的交互后开始卡住
如果不使用stream，第一次请求会正常，但是第二次一定卡死（我用的循环，每次以特定参数启动大模型后端，然后使用run_perf_benchmark(task_cfg)进行本轮压测）
基于华为服务器，后端是华为的 mindie 框架，以 openai api 格式启动的。
晚上我把--debug 的信息发出来