Repository: modelscope/evalscope
Issue: 文生图模型无法调用本地部署的服务
Root cause: Unimplemented Feature Gap

## 问题描述

我在本地部署了一个Qwen-Image服务：http://localhost:8895/v1/images/generations
现在想用evalscope来评测，无法访问该链接


## EvalScope 版本（必填）
v1.2.0

## 执行的代码或指令

nohup evalscope eval \
  --model /data02/Qwen-Image \
  --api-url http://localhost:8895/v1/images/generations \
  --model-task image_generation \
  --api-key EMPTY \
  --eval-type openai_api  \
  --datasets evalmuse genai_bench general_t2i hpdv2 tifa160 \
  --eval-batch-size 1 \
  --timeout 60 \
  --stream \
  --limit 10 \
  > evalscope-Qwen-Image.log 2>&1 &



## 错误日志

File "/data01/lht/lht_env/lib/python3.11/site-packages/openai/_base_client.py", line 1259, in post
    return cast(ResponseT, self.request(cast_to, opts, stream=stream, stream_cls=stream_cls))
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/data01/lht/lht_env/lib/python3.11/site-packages/openai/_base_client.py", line 1047, in request
    raise self._make_status_error_from_response(err.response) from None
openai.NotFoundError: Error code: 404 - {'code': 400001, 'message': '请求路径错误', 'details': '请求路径错误'}

发现它会在请求的路径上拼上/chat/completions

若将--eval-type openai_api改为service，则显示不存在service参数：ValueError: Model API 'service' is not registered. Available model APIs: ['mock_llm', 'openai_api', 'server', 'llm_ckpt', 'checkpoint', 'text2image', 'image_editing']

若将evalscope版本降至0.17.0，则会报错：

File "/data01/lht/lht_env/lib/python3.11/site-packages/evalscope/metrics/t2v_metrics/__init__.py", line 44, in fga_blip2_score
    from .itmscore import ITMScore
  File "/data01/lht/lht_env/lib/python3.11/site-packages/evalscope/metrics/t2v_metrics/itmscore.py", line 4, in <module>
    from .models.itmscore_models import get_itmscore_model, list_all_itmscore_models
  File "/data01/lht/lht_env/lib/python3.11/site-packages/evalscope/metrics/t2v_metrics/models/itmscore_models/__init__.py", line 2, in <module>
    from .blip2_itm_model import BLIP2_ITM_MODELS, BLIP2ITMScoreModel
  File "/data01/lht/lht_env/lib/python3.11/site-packages/evalscope/metrics/t2v_metrics/models/itmscore_models/blip2_itm_model.py", line 8, in <module>
    from ..vqascore_models.lavis.models import load_model
  File "/data01/lht/lht_env/lib/python3.11/site-packages/evalscope/metrics/t2v_metrics/models/vqascore_models/lavis/__init__.py", line 13, in <module>
    from .models import *
  File "/data01/lht/lht_env/lib/python3.11/site-packages/evalscope/metrics/t2v_metrics/models/vqascore_models/lavis/models/__init__.py", line 15, in <module>
    from .blip2_models.blip2 import Blip2Base
  File "/data01/lht/lht_env/lib/python3.11/site-packages/evalscope/metrics/t2v_metrics/models/vqascore_models/lavis/models/blip2_models/blip2.py", line 26, in <module>
    from .Qformer import BertConfig, BertLMHeadModel
  File "/data01/lht/lht_env/lib/python3.11/site-packages/evalscope/metrics/t2v_metrics/models/vqascore_models/lavis/models/blip2_models/Qformer.py", line 27, in <module>
    from transformers.modeling_utils import (PreTrainedModel, apply_chunking_to_forward, find_pruneable_heads_and_indices,
ImportError: cannot import name 'apply_chunking_to_forward' from 'transformers.modeling_utils' (/data01/lht/lht_env/lib/python3.11/site-packages/transformers/modeling_utils.py)


## 运行环境

- 操作系统：ctyunos 23.01 2
- Python版本：3.11.14

## 其他信息

希望可以提供一个评测本地部署的http://localhost:8895/v1/images/generations链接的文生图精度评测方式，谢谢！


文生图模型还不支持通过服务进行评测，后续支持