Repository: modelscope/evalscope
Issue: 总是遇到{'num_prompt_tokens': 0, 'num_generated_tokens': 0, 'num_samples': 0, 'runtime': 20.00112988, 'samples/s': 0.0, 'tokens/s': 0.0}是什么原因？
Root cause: Validation Gap

## 自查清单

在提交 issue 之前，请确保您已完成以下步骤:
- [x] 我已仔细阅读了[相关使用说明文档](https://evalscope.readthedocs.io/zh-cn/latest/get_started/parameters.html)
- [x] 我已查看了[常见问题解答](https://evalscope.readthedocs.io/zh-cn/latest/get_started/faq.html)
- [x] 我已搜索并查看了现有的 issues，确认这不是一个重复的问题

## 问题描述

总是遇到{'num_prompt_tokens': 0, 'num_generated_tokens': 0, 'num_samples': 0, 'runtime': 20.00112988, 'samples/s': 0.0, 'tokens/s': 0.0}是什么原因？

## EvalScope 版本（必填）
v0.16.1
## 使用的工具
- [x] Native / 原生框架
- [ ] Opencompass backend
- [ ] VLMEvalKit backend
- [ ] RAGEval backend
- [ ] Perf / 模型推理压测工具
- [ ] Arena / 竞技场模式

## 执行的代码或指令
```
swift eval \
    --model /Users/aaa/Downloads/models/Qwen3-1.7B \
    --eval_backend Native \
    --infer_backend pt \
    --eval_limit 10 \
    --eval_dataset  aime24
```
## 错误日志
```
(ms-swift) (base) aaa@U-P2GY409C-2044 ms-swift-main % pip install plotly
Collecting plotly
  Downloading plotly-6.1.2-py3-none-any.whl.metadata (6.9 kB)
Collecting narwhals>=1.15.1 (from plotly)
  Downloading narwhals-1.41.0-py3-none-any.whl.metadata (11 kB)
Requirement already satisfied: packaging in /Users/aaa/miniforge3/envs/ms-swift/lib/python3.10/site-packages (from plotly) (25.0)
Downloading plotly-6.1.2-py3-none-any.whl (16.3 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 16.3/16.3 MB 4.8 MB/s eta 0:00:00
Downloading narwhals-1.41.0-py3-none-any.whl (357 kB)
Installing collected packages: narwhals, plotly
Successfully installed narwhals-1.41.0 plotly-6.1.2
(ms-swift) (base) aaa@U-P2GY409C-2044 ms-swift-main % evalscope app     
* Running on local URL:  http://0.0.0.0:7860/
* To create a public link, set `share=True` in `launch()`.
share=True
^CKeyboard interruption in main thread... closing server.
(ms-swift) (base) aaa@U-P2GY409C-2044 ms-swift-main % evalscope app share=TRUE
usage: evalscope <command> [<args>]
EvalScope Command Line tool: error: unrecognized arguments: share=TRUE
(ms-swift) (base) aaa@U-P2GY409C-2044 ms-swift-main % bash _.sh               
run sh: `/Users/aaa/miniforge3/envs/ms-swift/bin/python3.10 /Users/aaa/miniforge3/envs/ms-swift/lib/python3.10/site-packages/swift/cli/eval.py --model /Users/aaa/Downloads/models/Qwen3-1.7B --eval_backend Native --infer_backend pt --eval_limit 10 --eval_dataset aime24`
[INFO:swift] Successfully registered `/Users/aaa/miniforge3/envs/ms-swift/lib/python3.10/site-packages/swift/llm/dataset/data/dataset_info.json`.
[INFO:swift] rank: -1, local_rank: -1, world_size: 1, local_world_size: 1
[INFO:swift] Loading the model using model_dir: /Users/aaa/Downloads/models/Qwen3-1.7B
[INFO:swift] Setting torch_dtype: torch.bfloat16
[INFO:swift] args.result_path: /Users/aaa/Downloads/rlhf_code/ms-swift-main/result/Qwen3-1.7B/eval_result/20250606-153646.jsonl
/Users/aaa/miniforge3/envs/ms-swift/lib/python3.10/site-packages/torch/amp/autocast_mode.py:266: UserWarning: User provided device_type of 'cuda', but CUDA is not available. Disabling
  warnings.warn(
[INFO:swift] eval_backend: Native
[INFO:swift] eval_dataset: ['aime24']
[INFO:swift] eval_output_dir: /Users/aaa/Downloads/rlhf_code/ms-swift-main/eval_output
[INFO:swift] Global seed set to 42
[INFO:swift] args: EvalArguments(model='/Users/aaa/Downloads/models/Qwen3-1.7B', model_type='qwen3', model_revision=None, task_type='causal_lm', torch_dtype=torch.bfloat16, attn_impl=None, num_labels=None, problem_type=None, rope_scaling=None, device_map=None, max_memory={}, local_repo_path=None, init_strategy=None, template='qwen3', system=None, max_length=None, truncation_strategy='delete', max_pixels=None, agent_template=None, norm_bbox=None, response_prefix=None, padding_side='right', loss_scale='default', sequence_parallel_size=1, use_chat_template=True, template_backend='swift', dataset=[], val_dataset=[], split_dataset_ratio=0.01, data_seed=42, dataset_num_proc=1, load_from_cache_file=True, dataset_shuffle=True, val_dataset_shuffle=False, streaming=False, interleave_prob=None, stopping_strategy='first_exhausted', shuffle_buffer_size=1000, download_mode='reuse_dataset_if_exists', columns={}, strict=False, remove_unused_columns=True, model_name=[None, None], model_author=[None, None], custom_dataset_info=[], quant_method=None, quant_bits=None, hqq_axis=None, bnb_4bit_compute_dtype=torch.bfloat16, bnb_4bit_quant_type='nf4', bnb_4bit_use_double_quant=True, bnb_4bit_quant_storage=None, max_new_tokens=None, temperature=0.0, top_k=None, top_p=None, repetition_penalty=None, num_beams=1, stream=False, stop_words=[], logprobs=False, top_logprobs=None, ckpt_dir=None, lora_modules=[], tuner_backend='peft', train_type='lora', adapters=[], external_plugins=[], seed=42, model_kwargs={}, load_args=True, load_data_args=False, use_hf=False, hub_token=None, custom_register_path=[], ddp_timeout=18000000, ddp_backend=None, ignore_args_error=False, use_swift_lora=False, tp=1, session_len=None, cache_max_entry_count=0.8, quant_policy=0, vision_batch_size=1, gpu_memory_utilization=0.9, tensor_parallel_size=1, pipeline_parallel_size=1, max_num_seqs=256, max_model_len=None, disable_custom_all_reduce=False, enforce_eager=False, limit_mm_per_prompt={}, vllm_max_lora_rank=16, enable_prefix_caching=False, use_async_engine=True, data_parallel_size=1, log_level='info', vllm_quantization=None, merge_lora=False, safe_serialization=True, max_shard_size='5GB', infer_backend='pt', result_path='/Users/aaa/Downloads/rlhf_code/ms-swift-main/result/Qwen3-1.7B/eval_result/20250606-153646.jsonl', metric=None, max_batch_size=1, val_dataset_sample=None, host='0.0.0.0', port=8001, api_key=None, ssl_keyfile=None, ssl_certfile=None, owned_by='swift', served_model_name=None, verbose=False, log_interval=20, max_logprobs=20, eval_dataset=['aime24'], eval_limit=10, dataset_args={}, eval_generation_config={}, eval_output_dir='/Users/aaa/Downloads/rlhf_code/ms-swift-main/eval_output', eval_backend='Native', local_dataset=False, eval_num_proc=16, extra_eval_args={}, eval_url=None)
[INFO:swift] Start time of running main: 2025-06-06 15:36:48.450875
[INFO:swift] rank: -1, local_rank: -1, world_size: 1, local_world_size: 1
[INFO:swift] Loading the model using model_dir: /Users/aaa/Downloads/models/Qwen3-1.7B
[INFO:swift] Successfully registered `/Users/aaa/miniforge3/envs/ms-swift/lib/python3.10/site-packages/swift/llm/dataset/data/dataset_info.json`.
[INFO:swift] Global seed set to 42
[INFO:swift] args: DeployArguments(model='/Users/aaa/Downloads/models/Qwen3-1.7B', model_type='qwen3', model_revision=None, task_type='causal_lm', torch_dtype=torch.bfloat16, attn_impl=None, num_labels=None, problem_type=None, rope_scaling=None, device_map=None, max_memory={}, local_repo_path=None, init_strategy=None, template='qwen3', system=None, max_length=None, truncation_strategy='delete', max_pixels=None, agent_template=None, norm_bbox=None, response_prefix=None, padding_side='right', loss_scale='default', sequence_parallel_size=1, use_chat_template=True, template_backend='swift', dataset=[], val_dataset=[], split_dataset_ratio=0.01, data_seed=42, dataset_num_proc=1, load_from_cache_file=True, dataset_shuffle=True, val_dataset_shuffle=False, streaming=False, interleave_prob=None, stopping_strategy='first_exhausted', shuffle_buffer_size=1000, download_mode='reuse_dataset_if_exists', columns={}, strict=False, remove_unused_columns=True, model_name=[None, None], model_author=[None, None], custom_dataset_info=[], quant_method=None, quant_bits=None, hqq_axis=None, bnb_4bit_compute_dtype=torch.bfloat16, bnb_4bit_quant_type='nf4', bnb_4bit_use_double_quant=True, bnb_4bit_quant_storage=None, max_new_tokens=None, temperature=0.0, top_k=None, top_p=None, repetition_penalty=None, num_beams=1, stream=False, stop_words=[], logprobs=False, top_logprobs=None, ckpt_dir=None, lora_modules=[], tuner_backend='peft', train_type='lora', adapters=[], external_plugins=[], seed=42, model_kwargs={}, load_args=True, load_data_args=False, use_hf=False, hub_token=None, custom_register_path=[], ddp_timeout=18000000, ddp_backend=None, ignore_args_error=False, use_swift_lora=False, tp=1, session_len=None, cache_max_entry_count=0.8, quant_policy=0, vision_batch_size=1, gpu_memory_utilization=0.9, tensor_parallel_size=1, pipeline_parallel_size=1, max_num_seqs=256, max_model_len=None, disable_custom_all_reduce=False, enforce_eager=False, limit_mm_per_prompt={}, vllm_max_lora_rank=16, enable_prefix_caching=False, use_async_engine=True, data_parallel_size=1, log_level='info', vllm_quantization=None, merge_lora=False, safe_serialization=True, max_shard_size='5GB', infer_backend='pt', result_path='/Users/aaa/Downloads/rlhf_code/ms-swift-main/result/Qwen3-1.7B/eval_result/20250606-153646.jsonl', metric=None, max_batch_size=1, val_dataset_sample=None, host='0.0.0.0', port=8001, api_key=None, ssl_keyfile=None, ssl_certfile=None, owned_by='swift', served_model_name=None, verbose=False, log_interval=20, max_logprobs=20)
[INFO:swift] Loading the model using model_dir: /Users/aaa/Downloads/models/Qwen3-1.7B
[INFO:swift] model_kwargs: {'device_map': 'mps:0'}
Loading checkpoint shards: 100%|█████████████████████████████████████████████| 2/2 [00:03<00:00,  1.79s/it]
[INFO:swift] default_system: None
[INFO:swift] response_prefix: ''
[INFO:swift] agent_template: hermes
[INFO:swift] max_length: 40960
[INFO:swift] norm_bbox: norm1000
[INFO:swift] model: Qwen3ForCausalLM(
  (model): Qwen3Model(
    (embed_tokens): Embedding(151936, 2048)
    (layers): ModuleList(
      (0-27): 28 x Qwen3DecoderLayer(
        (self_attn): Qwen3Attention(
          (q_proj): Linear(in_features=2048, out_features=2048, bias=False)
          (k_proj): Linear(in_features=2048, out_features=1024, bias=False)
          (v_proj): Linear(in_features=2048, out_features=1024, bias=False)
          (o_proj): Linear(in_features=2048, out_features=2048, bias=False)
          (q_norm): Qwen3RMSNorm((128,), eps=1e-06)
          (k_norm): Qwen3RMSNorm((128,), eps=1e-06)
        )
        (mlp): Qwen3MLP(
          (gate_proj): Linear(in_features=2048, out_features=6144, bias=False)
          (up_proj): Linear(in_features=2048, out_features=6144, bias=False)
          (down_proj): Linear(in_features=6144, out_features=2048, bias=False)
          (act_fn): SiLU()
        )
        (input_layernorm): Qwen3RMSNorm((2048,), eps=1e-06)
        (post_attention_layernorm): Qwen3RMSNorm((2048,), eps=1e-06)
      )
    )
    (norm): Qwen3RMSNorm((2048,), eps=1e-06)
    (rotary_emb): Qwen3RotaryEmbedding()
  )
  (lm_head): Linear(in_features=2048, out_features=151936, bias=False)
)
[INFO:swift] Start time of running main: 2025-06-06 15:36:56.796883
[INFO:swift] model_list: ['Qwen3-1.7B']
INFO:     Started server process [73818]
INFO:     Waiting for application startup.
INFO:     Application startup complete.
INFO:     Uvicorn running on http://0.0.0.0:8001/ (Press CTRL+C to quit)
INFO:     127.0.0.1:55389 - "GET /v1/models HTTP/1.1" 200 OK
2025-06-06 15:36:57,532 - evalscope - INFO - Args: Task config is provided with TaskConfig type.
2025-06-06 15:36:57,716 - evalscope - INFO - Dump task config to /Users/aaa/Downloads/rlhf_code/ms-swift-main/eval_output/native/20250606_153657/configs/task_config_8631b1.yaml
2025-06-06 15:36:57,718 - evalscope - INFO - {
    "model": "Qwen3-1.7B",
    "model_id": "Qwen3-1.7B",
    "model_args": {},
    "model_task": "text_generation",
    "template_type": null,
    "chat_template": null,
    "datasets": [
        "aime24"
    ],
    "dataset_args": {
        "aime24": {
            "name": "aime24",
            "dataset_id": "HuggingFaceH4/aime_2024",
            "model_adapter": "generation",
            "output_types": [
                "generation"
            ],
            "subset_list": [
                "default"
            ],
            "metric_list": [
                "AveragePass@1"
            ],
            "few_shot_num": 0,
            "few_shot_random": false,
            "train_split": null,
            "eval_split": "train",
            "prompt_template": "{query}\nPlease reason step by step, and put your final answer within \\boxed{{}}.",
            "system_prompt": null,
            "query_template": null,
            "pretty_name": "AIME-2024",
            "description": null,
            "filters": null,
            "extra_params": {}
        }
    },
    "dataset_dir": "/Users/aaa/.cache/modelscope/hub/datasets",
    "dataset_hub": "modelscope",
    "generation_config": {
        "max_tokens": 2048,
        "temperature": 0.0
    },
    "eval_type": "service",
    "eval_backend": "Native",
    "eval_config": null,
    "stage": "all",
    "limit": 10,
    "eval_batch_size": 16,
    "mem_cache": false,
    "use_cache": null,
    "work_dir": "/Users/aaa/Downloads/rlhf_code/ms-swift-main/eval_output/native/20250606_153657",
    "outputs": null,
    "ignore_errors": false,
    "debug": false,
    "dry_run": false,
    "seed": 42,
    "api_url": "[http://127.0.0.1:8001/v1/chat/completions",](http://127.0.0.1:8001/v1/chat/completions%22,)
    "api_key": "EMPTY",
    "timeout": null,
    "stream": false,
    "judge_strategy": "auto",
    "judge_worker_num": 1,
    "judge_model_args": {},
    "analysis_report": false
}
2025-06-06 15:36:57,718 - evalscope - INFO - Start evaluating on dataset HuggingFaceH4/aime_2024
2025-06-06 15:36:57,718 - evalscope - INFO - Loading dataset from hub: HuggingFaceH4/aime_2024
2025-06-06 15:36:57,746 - evalscope - INFO - Loading dataset: dataset_name: HuggingFaceH4/aime_2024 > subsets: ['default']
[WARNING:modelscope] Use trust_remote_code=True. Will invoke codes from aime_2024. Please make sure that you can trust the external codes.
[WARNING:modelscope] Use trust_remote_code=True. Will invoke codes from HuggingFaceH4/aime_2024. Please make sure that you can trust the external codes.
[WARNING:modelscope] Use trust_remote_code=True. Will invoke codes from HuggingFaceH4/aime_2024. Please make sure that you can trust the external codes.
[WARNING:modelscope] Use trust_remote_code=True. Will invoke codes from HuggingFaceH4/aime_2024. Please make sure that you can trust the external codes.
Downloading [README.md]: 100%|████████████████████████████████████████████| 932/932 [00:00<00:00, 13.7MB/s]
[INFO:modelscope] storing https://www.modelscope.cn/api/v1/datasets/HuggingFaceH4/aime_2024/repo?Source=SDK&Revision=master&FilePath=README.md&View=False in cache at /Users/aaa/.cache/modelscope/hub/datasets/49a9bb4ec8b0cfdd0244a32a6a99cda11259e8a3abd4e805fa1b0035ae6859c4
[INFO:modelscope] creating metadata file for /Users/aaa/.cache/modelscope/hub/datasets/49a9bb4ec8b0cfdd0244a32a6a99cda11259e8a3abd4e805fa1b0035ae6859c4
Downloading data: 100%|███████████████████████████████████████████████| 81.7k/81.7k [00:00<00:00, 2.44MB/s]
[INFO:modelscope] storing https://www.modelscope.cn/api/v1/datasets/HuggingFaceH4/aime_2024/repo?Source=SDK&Revision=master&FilePath=data%2Ftrain-00000-of-00001.parquet in cache at /Users/aaa/.cache/modelscope/hub/datasets/downloads/f7b7dffd58d5567b20dcd6a2d16cbb1c9f3cd1365aa8b396eee649fa53e17f36
[INFO:modelscope] creating metadata file for /Users/aaa/.cache/modelscope/hub/datasets/downloads/f7b7dffd58d5567b20dcd6a2d16cbb1c9f3cd1365aa8b396eee649fa53e17f36
Generating train split: 100%|█████████████████████████████████████| 30/30 [00:00<00:00, 1256.81 examples/s]
2025-06-06 15:37:05,645 - evalscope - INFO - Use settings: > few_shot_num: 0, > few_shot_split: None, > target_eval_split: train
Predicting(default):   0%|                                                          | 0/10 [00:00<?, ?it/s][INFO:swift] {'num_prompt_tokens': 0, 'num_generated_tokens': 0, 'num_samples': 0, 'runtime': 20.20116171, 'samples/s': 0.0, 'tokens/s': 0.0}
[INFO:swift] {'num_prompt_tokens': 0, 'num_generated_tokens': 0, 'num_samples': 0, 'runtime': 20.00092833, 'samples/s': 0.0, 'tokens/s': 0.0}
[INFO:swift] {'num_prompt_tokens': 0, 'num_generated_tokens': 0, 'num_samples': 0, 'runtime': 20.00117654, 'samples/s': 0.0, 'tokens/s': 0.0}
[INFO:swift] {'num_prompt_tokens': 0, 'num_generated_tokens': 0, 'num_samples': 0, 'runtime': 20.00119221, 'samples/s': 0.0, 'tokens/s': 0.0}
[INFO:swift] {'num_prompt_tokens': 0, 'num_generated_tokens': 0, 'num_samples': 0, 'runtime': 20.00060588, 'samples/s': 0.0, 'tokens/s': 0.0}
[INFO:swift] {'num_prompt_tokens': 0, 'num_generated_tokens': 0, 'num_samples': 0, 'runtime': 20.00032592, 'samples/s': 0.0, 'tokens/s': 0.0}
[INFO:swift] {'num_prompt_tokens': 0, 'num_generated_tokens': 0, 'num_samples': 0, 'runtime': 20.00117579, 'samples/s': 0.0, 'tokens/s': 0.0}
[INFO:swift] {'num_prompt_tokens': 0, 'num_generated_tokens': 0, 'num_samples': 0, 'runtime': 20.00121958, 'samples/s': 0.0, 'tokens/s': 0.0}
[INFO:swift] {'num_prompt_tokens': 0, 'num_generated_tokens': 0, 'num_samples': 0, 'runtime': 20.00124433, 'samples/s': 0.0, 'tokens/s': 0.0}
[INFO:swift] {'num_prompt_tokens': 0, 'num_generated_tokens': 0, 'num_samples': 0, 'runtime': 20.00120879, 'samples/s': 0.0, 'tokens/s': 0.0}
INFO:     127.0.0.1:55415 - "POST /v1/chat/completions HTTP/1.1" 200 OK
Predicting(default):  10%|████▉                                            | 1/10 [03:25<30:46, 205.17s/it][INFO:swift] {'num_prompt_tokens': 99, 'num_generated_tokens': 2048, 'num_samples': 1, 'runtime': 20.00021508, 'samples/s': 0.04999946, 'tokens/s': 102.39889879}
[INFO:swift] {'num_prompt_tokens': 0, 'num_generated_tokens': 0, 'num_samples': 0, 'runtime': 20.00058387, 'samples/s': 0.0, 'tokens/s': 0.0}
[INFO:swift] {'num_prompt_tokens': 0, 'num_generated_tokens': 0, 'num_samples': 0, 'runtime': 20.0002025, 'samples/s': 0.0, 'tokens/s': 0.0}
[INFO:swift] {'num_prompt_tokens': 0, 'num_generated_tokens': 0, 'num_samples': 0, 'runtime': 20.001184, 'samples/s': 0.0, 'tokens/s': 0.0}
[INFO:swift] {'num_prompt_tokens': 0, 'num_generated_tokens': 0, 'num_samples': 0, 'runtime': 20.00041108, 'samples/s': 0.0, 'tokens/s': 0.0}
[INFO:swift] {'num_prompt_tokens': 0, 'num_generated_tokens': 0, 'num_samples': 0, 'runtime': 20.00108879, 'samples/s': 0.0, 'tokens/s': 0.0}
[INFO:swift] {'num_prompt_tokens': 0, 'num_generated_tokens': 0, 'num_samples': 0, 'runtime': 20.00131317, 'samples/s': 0.0, 'tokens/s': 0.0}
[INFO:swift] {'num_prompt_tokens': 0, 'num_generated_tokens': 0, 'num_samples': 0, 'runtime': 20.00074233, 'samples/s': 0.0, 'tokens/s': 0.0}
[INFO:swift] {'num_prompt_tokens': 0, 'num_generated_tokens': 0, 'num_samples': 0, 'runtime': 20.00082242, 'samples/s': 0.0, 'tokens/s': 0.0}
[INFO:swift] {'num_prompt_tokens': 0, 'num_generated_tokens': 0, 'num_samples': 0, 'runtime': 20.00110542, 'samples/s': 0.0, 'tokens/s': 0.0}
[INFO:swift] {'num_prompt_tokens': 0, 'num_generated_tokens': 0, 'num_samples': 0, 'runtime': 20.00126346, 'samples/s': 0.0, 'tokens/s': 0.0}
[INFO:swift] {'num_prompt_tokens': 0, 'num_generated_tokens': 0, 'num_samples': 0, 'runtime': 20.00027642, 'samples/s': 0.0, 'tokens/s': 0.0}
INFO:     127.0.0.1:55416 - "POST /v1/chat/completions HTTP/1.1" 200 OK
Predicting(default):  20%|█████████▊                                       | 2/10 [07:13<29:11, 218.91s/it][INFO:swift] {'num_prompt_tokens': 104, 'num_generated_tokens': 2048, 'num_samples': 1, 'runtime': 20.00030142, 'samples/s': 0.04999925, 'tokens/s': 102.39845677}
[INFO:swift] {'num_prompt_tokens': 0, 'num_generated_tokens': 0, 'num_samples': 0, 'runtime': 20.000465, 'samples/s': 0.0, 'tokens/s': 0.0}
[INFO:swift] {'num_prompt_tokens': 0, 'num_generated_tokens': 0, 'num_samples': 0, 'runtime': 20.00135062, 'samples/s': 0.0, 'tokens/s': 0.0}
[INFO:swift] {'num_prompt_tokens': 0, 'num_generated_tokens': 0, 'num_samples': 0, 'runtime': 20.00123892, 'samples/s': 0.0, 'tokens/s': 0.0}
[INFO:swift] {'num_prompt_tokens': 0, 'num_generated_tokens': 0, 'num_samples': 0, 'runtime': 20.00120063, 'samples/s': 0.0, 'tokens/s': 0.0}
[INFO:swift] {'num_prompt_tokens': 0, 'num_generated_tokens': 0, 'num_samples': 0, 'runtime': 20.00124642, 'samples/s': 0.0, 'tokens/s': 0.0}
[INFO:swift] {'num_prompt_tokens': 0, 'num_generated_tokens': 0, 'num_samples': 0, 'runtime': 20.00116217, 'samples/s': 0.0, 'tokens/s': 0.0}
[INFO:swift] {'num_prompt_tokens': 0, 'num_generated_tokens': 0, 'num_samples': 0, 'runtime': 20.00120583, 'samples/s': 0.0, 'tokens/s': 0.0}
[INFO:swift] {'num_prompt_tokens': 0, 'num_generated_tokens': 0, 'num_samples': 0, 'runtime': 20.00049021, 'samples/s': 0.0, 'tokens/s': 0.0}
[INFO:swift] {'num_prompt_tokens': 0, 'num_generated_tokens': 0, 'num_samples': 0, 'runtime': 20.00040979, 'samples/s': 0.0, 'tokens/s': 0.0}
[INFO:swift] {'num_prompt_tokens': 0, 'num_generated_tokens': 0, 'num_samples': 0, 'runtime': 20.00110738, 'samples/s': 0.0, 'tokens/s': 0.0}
```
## 运行环境

- 操作系统：macos
- Python版本：3.10.0

## 其他信息

如果有其他相关信息，请在此处提供。


这是打印的log，可以忽略

> 这是打印的log，可以忽略

好的，谢谢！