Repository: open-compass/opencompass
Issue: [Bug] 官网 Command Line 示例跑不通
Root cause: Environment Incompatibility

### Prerequisite

- [X] I have searched [Issues](https://github.com/open-compass/opencompass/issues/) and [Discussions](https://github.com/open-compass/opencompass/discussions) but cannot get the expected help.
- [X] The bug has not been fixed in the [latest version](https://github.com/open-compass/opencompass).

### Type

I'm evaluating with the officially supported tasks/models/datasets.

### Environment

{'CUDA available': True,
'CUDA_HOME': '/usr/local/cuda',
'GCC': 'gcc (Ubuntu 9.4.0-1ubuntu1~20.04.1) 9.4.0',
'GPU 0,1,2,3,4,5,6,7': 'NVIDIA GeForce RTX 3090',
'MMEngine': '0.8.4',
'NVCC': 'Cuda compilation tools, release 11.3, V11.3.109',
'OpenCV': '4.8.0',
'PyTorch': '2.0.1',
'PyTorch compiling details': 'PyTorch built with:\n'
' - GCC 9.3\n'
' - C++ Version: 201703\n'
' - Intel(R) oneAPI Math Kernel Library Version '
'2023.1-Product Build 20230303 for Intel(R) 64 '
'architecture applications\n'
' - Intel(R) MKL-DNN v2.7.3 (Git Hash '
'6dbeffbae1f23cbbeae17adb7b5b13f1f37c080e)\n'
' - OpenMP 201511 (a.k.a. OpenMP 4.5)\n'
' - LAPACK is enabled (usually provided by '
'MKL)\n'
' - NNPACK is enabled\n'
' - CPU capability usage: AVX2\n'
' - CUDA Runtime 11.8\n'
' - NVCC architecture flags: '
'-gencode;arch=compute_37,code=sm_37;-gencode;arch=compute_50,code=sm_50;-gencode;arch=compute_60,code=sm_60;-gencode;arch=compute_61,code=sm_61;-gencode;arch=compute_70,code=sm_70;-gencode;arch=compute_75,code=sm_75;-gencode;arch=compute_80,code=sm_80;-gencode;arch=compute_86,code=sm_86;-gencode;arch=compute_90,code=sm_90;-gencode;arch=compute_37,code=compute_37\n'
' - CuDNN 8.7\n'
' - Magma 2.6.1\n'
' - Build settings: BLAS_INFO=mkl, '
'BUILD_TYPE=Release, CUDA_VERSION=11.8, '
'CUDNN_VERSION=8.7.0, '
'CXX_COMPILER=/opt/rh/devtoolset-9/root/usr/bin/c++, '
'CXX_FLAGS= -D_GLIBCXX_USE_CXX11_ABI=0 '
'-fabi-version=11 -Wno-deprecated '
'-fvisibility-inlines-hidden -DUSE_PTHREADPOOL '
'-DNDEBUG -DUSE_KINETO -DLIBKINETO_NOROCTRACER '
'-DUSE_FBGEMM -DUSE_QNNPACK '
'-DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK '
'-DSYMBOLICATE_MOBILE_DEBUG_HANDLE -O2 -fPIC '
'-Wall -Wextra -Werror=return-type '
'-Werror=non-virtual-dtor -Werror=bool-operation '
'-Wnarrowing -Wno-missing-field-initializers '
'-Wno-type-limits -Wno-array-bounds '
'-Wno-unknown-pragmas -Wunused-local-typedefs '
'-Wno-unused-parameter -Wno-unused-function '
'-Wno-unused-result -Wno-strict-overflow '
'-Wno-strict-aliasing '
'-Wno-error=deprecated-declarations '
'-Wno-stringop-overflow -Wno-psabi '
'-Wno-error=pedantic -Wno-error=redundant-decls '
'-Wno-error=old-style-cast '
'-fdiagnostics-color=always -faligned-new '
'-Wno-unused-but-set-variable '
'-Wno-maybe-uninitialized -fno-math-errno '
'-fno-trapping-math -Werror=format '
'-Werror=cast-function-type '
'-Wno-stringop-overflow, LAPACK_INFO=mkl, '
'PERF_WITH_AVX=1, PERF_WITH_AVX2=1, '
'PERF_WITH_AVX512=1, '
'TORCH_DISABLE_GPU_ASSERTS=ON, '
'TORCH_VERSION=2.0.1, USE_CUDA=ON, USE_CUDNN=ON, '
'USE_EXCEPTION_PTR=1, USE_GFLAGS=OFF, '
'USE_GLOG=OFF, USE_MKL=ON, USE_MKLDNN=ON, '
'USE_MPI=OFF, USE_NCCL=ON, USE_NNPACK=ON, '
'USE_OPENMP=ON, USE_ROCM=OFF, \n',
'Python': '3.10.12 (main, Jul 5 2023, 18:54:27) [GCC 11.2.0]',
'TorchVision': '0.15.2',
'numpy_random_seed': 2147483648,
'opencompass': '0.1.4+63ced82',
'sys.platform': 'linux'}

### Reproduces the problem - code/configuration sample

python run.py --datasets siqa_gen winograd_ppl \
--hf-path facebook/opt-125m \
--model-kwargs device_map='auto' \
--tokenizer-kwargs padding_side='left' truncation='left' trust_remote_code=True \
--max-seq-len 2048 \
--max-out-len 100 \
--batch-size 128  \
--num-gpus 2

### Reproduces the problem - command or script

python run.py --datasets siqa_gen winograd_ppl \
--hf-path facebook/opt-125m \
--model-kwargs device_map='auto' \
--tokenizer-kwargs padding_side='left' truncation='left' trust_remote_code=True \
--max-seq-len 2048 \
--max-out-len 100 \
--batch-size 128  \
--num-gpus 1

### Reproduces the problem - error message

09/11 15:09:41 - OpenCompass - INFO - Loading siqa_gen: configs/datasets/siqa/siqa_gen.py
09/11 15:09:41 - OpenCompass - INFO - Loading winograd_ppl: configs/datasets/winograd/winograd_ppl.py
09/11 15:09:41 - OpenCompass - WARNING - SlurmRunner is not used, so the partition argument is ignored.
09/11 15:09:41 - OpenCompass - INFO - Partitioned into 1 tasks.
launch OpenICLInfer[opencompass.models.huggingface.HuggingFace_facebook_opt-125m/siqa,opencompass.models.huggingface.HuggingFace_facebook_opt-125m/winograd] on GPU 0,1
  0%|                                                                                                    | 0/1 [00:00<?, ?it/s]09/11 15:09:54 - OpenCompass - WARNING - task OpenICLInfer[opencompass.models.huggingface.HuggingFace_facebook_opt-125m/siqa,opencompass.models.huggingface.HuggingFace_facebook_opt-125m/winograd] fail, see
./outputs/default/20230911_150941/logs/infer/opencompass.models.huggingface.HuggingFace_facebook_opt-125m/siqa.out
100%|████████████████████████████████████████████████████████████████████████████████████████████| 1/1 [00:12<00:00, 12.68s/it]
09/11 15:09:54 - OpenCompass - ERROR - /root/opencompass/opencompass/runners/base.py - summarize - 63 - OpenICLInfer[opencompass.models.huggingface.HuggingFace_facebook_opt-125m/siqa,opencompass.models.huggingface.HuggingFace_facebook_opt-125m/winograd] failed with code 1
09/11 15:09:54 - OpenCompass - INFO - Partitioned into 2 tasks.
launch OpenICLEval[opencompass.models.huggingface.HuggingFace_facebook_opt-125m/siqa] on CPU
launch OpenICLEval[opencompass.models.huggingface.HuggingFace_facebook_opt-125m/winograd] on CPU
100%|████████████████████████████████████████████████████████████████████████████████████████████| 2/2 [00:10<00:00,  5.11s/it]
dataset    version    metric    mode    opencompass.models.huggingface.HuggingFace_facebook_opt-125m
---------  ---------  --------  ------  --------------------------------------------------------------
siqa       -          -         -       -
winograd   -          -         -       -
09/11 15:10:04 - OpenCompass - INFO - write summary to /root/opencompass/outputs/default/20230911_150941/summary/summary_20230911_150941.txt
09/11 15:10:04 - OpenCompass - INFO - write csv to /root/opencompass/outputs/default/20230911_150941/summary/summary_20230911_150941.csv

### Other information

官网文档，这看着不太像是环境问题。


Could you upload the content in 
`./outputs/default/20230911_150941/logs/infer/opencompass.models.huggingface.HuggingFace_facebook_opt-125m/siqa.out`
?

The error message there is more accurate.

```
09/11 15:09:45 - OpenCompass - INFO - Task [opencompass.models.huggingface.HuggingFace_facebook_opt-125m/siqa,opencompass.models.huggingface.HuggingFace_facebook_opt-125m/winograd]
^MDownloading (…)okenizer_config.json:   0%|          | 0.00/685 [00:00<?, ?B/s]^MDownloading (…)okenizer_config.json: 100%|██████████| 685/685 [00:00<00:00, 7.35MB/s]
^MDownloading (…)lve/main/config.json:   0%|          | 0.00/651 [00:00<?, ?B/s]^MDownloading (…)lve/main/config.json: 100%|██████████| 651/651 [00:00<00:00, 9.72MB/s]
^MDownloading (…)olve/main/vocab.json:   0%|          | 0.00/899k [00:00<?, ?B/s]^MDownloading (…)olve/main/vocab.json: 100%|██████████| 899k/899k [00:00<00:00, 1.16MB/s]^MDownloading (…)olve/main/vocab.json: 100%|██████████| 899k/899k [00:00<00:00, 1.16MB/s]
^MDownloading (…)olve/main/merges.txt:   0%|          | 0.00/456k [00:00<?, ?B/s]^MDownloading (…)olve/main/merges.txt: 100%|██████████| 456k/456k [00:00<00:00, 1.94MB/s]^MDownloading (…)olve/main/merges.txt: 100%|██████████| 456k/456k [00:00<00:00, 1.94MB/s]
^MDownloading (…)cial_tokens_map.json:   0%|          | 0.00/441 [00:00<?, ?B/s]^MDownloading (…)cial_tokens_map.json: 100%|██████████| 441/441 [00:00<00:00, 5.23MB/s]
Traceback (most recent call last):
  File "/home/pai/envs/opencompass/lib/python3.10/site-packages/urllib3/connectionpool.py", line 711, in urlopen
    self._prepare_proxy(conn)
  File "/home/pai/envs/opencompass/lib/python3.10/site-packages/urllib3/connectionpool.py", line 1007, in _prepare_proxy
    conn.connect()
  File "/home/pai/envs/opencompass/lib/python3.10/site-packages/urllib3/connection.py", line 419, in connect
    self.sock = ssl_wrap_socket(
  File "/home/pai/envs/opencompass/lib/python3.10/site-packages/urllib3/util/ssl_.py", line 449, in ssl_wrap_socket
    ssl_sock = _ssl_wrap_socket_impl(
  File "/home/pai/envs/opencompass/lib/python3.10/site-packages/urllib3/util/ssl_.py", line 493, in _ssl_wrap_socket_impl
    return ssl_context.wrap_socket(sock, server_hostname=server_hostname)
  File "/home/pai/envs/opencompass/lib/python3.10/ssl.py", line 513, in wrap_socket
    return self.sslsocket_class._create(
  File "/home/pai/envs/opencompass/lib/python3.10/ssl.py", line 1071, in _create
    self.do_handshake()
  File "/home/pai/envs/opencompass/lib/python3.10/ssl.py", line 1342, in do_handshake
    self._sslobj.do_handshake()
ssl.SSLEOFError: [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1007)

During handling of the above exception, another exception occurred:
uring handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pai/envs/opencompass/lib/python3.10/site-packages/requests/adapters.py", line 486, in send
    resp = conn.urlopen(
  File "/home/pai/envs/opencompass/lib/python3.10/site-packages/urllib3/connectionpool.py", line 798, in urlopen
    retries = retries.increment(
  File "/home/pai/envs/opencompass/lib/python3.10/site-packages/urllib3/util/retry.py", line 592, in increment
    raise MaxRetryError(_pool, url, error or ResponseError(cause))
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='cdn-lfs.huggingface.co', port=443): Max retries exceeded with url: /repos/41/79/4179336a0fd236024c42cf139f37d87e81cdc11dd2be9f7c4d5fb870edc3b3cd/2d74da6615135c58cf3cf9ad4cb11e7c613ff9e55fe658a47ab83b6c8d1174a9?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27pytorch_model.bin%3B+filename%3D%22pytorch_model.bin%22%3B&response-content-type=application%2Foctet-stream&Expires=1694675392&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTY5NDY3NTM5Mn19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy5odWdnaW5nZmFjZS5jby9yZXBvcy80MS83OS80MTc5MzM2YTBmZDIzNjAyNGM0MmNmMTM5ZjM3ZDg3ZTgxY2RjMTFkZDJiZTlmN2M0ZDVmYjg3MGVkYzNiM2NkLzJkNzRkYTY2MTUxMzVjNThjZjNjZjlhZDRjYjExZTdjNjEzZmY5ZTU1ZmU2NThhNDdhYjgzYjZjOGQxMTc0YTk~cmVzcG9uc2UtY29udGVudC1kaXNwb3NpdGlvbj0qJnJlc3BvbnNlLWNvbnRlbnQtdHlwZT0qIn1dfQ__&Signature=Y9cah7pD~j5P-Ra45TSUDcrstC1emxJYJAd6STrfzXR4k9EURl~ldAzEX-VJHj8yLBVUWpnakvDgAeix~wmZPqH5PEPTOxhtFIda-omIG5CMn5zZxv6ny~3pVBCN2hVGl1Hel-dMdDmAxJFXGV7yzC1tJjG4P5-iA1K5qpf1NAfPs8UdlJlZao3~aZBWUMQPis27mt78eZN7xyNVJaW-SAkldEbNxmOkGbB-FNfSswAbtyelwP8jWPn-nVzQacONNSijMl5DLn3eZ3hRDs3F00BMReqhSuYwnZuUF9jVRF2qs76SXt0ykoosG8~gwHubjfvENJbOnpeXhrUXuvDiKQ__&Key-Pair-Id=KVTP0A1DKRTAX (Caused by SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1007)')))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/root/opencompass/opencompass/tasks/openicl_infer.py", line 147, in <module>
    inferencer.run()
  File "/root/opencompass/opencompass/tasks/openicl_infer.py", line 60, in run
    self.model = build_model_from_cfg(model_cfg)
  File "/root/opencompass/opencompass/utils/build.py", line 23, in build_model_from_cfg
    return MODELS.build(model_cfg)
  File "/home/pai/envs/opencompass/lib/python3.10/site-packages/mmengine/registry/registry.py", line 570, in build
    return self.build_func(cfg, *args, **kwargs, registry=self)
  File "/home/pai/envs/opencompass/lib/python3.10/site-packages/mmengine/registry/build_functions.py", line 121, in build_from_cfg
    obj = obj_cls(**args)  # type: ignore
  File "/root/opencompass/opencompass/models/huggingface.py", line 82, in __init__
    self._load_model(path=path,
  File "/root/opencompass/opencompass/models/huggingface.py", line 136, in _load_model
    self.model = AutoModelForCausalLM.from_pretrained(
  File "/root/opencompass/opencompass/utils/fileio.py", line 162, in auto_pt
    res = ori_auto_pt.__func__(cls, pretrained_model_name_or_path,
  File "/home/pai/envs/opencompass/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py", line 563, in from_pretrained
    return model_class.from_pretrained(
  File "/root/opencompass/opencompass/utils/fileio.py", line 138, in model_pt
    res = ori_model_pt.__func__(cls, pretrained_model_name_or_path,
  File "/home/pai/envs/opencompass/lib/python3.10/site-packages/transformers/modeling_utils.py", line 2793, in from_pretrained
    resolved_archive_file = cached_file(
  File "/home/pai/envs/opencompass/lib/python3.10/site-packages/transformers/utils/hub.py", line 429, in cached_file
    resolved_file = hf_hub_download(
  File "/home/pai/envs/opencompass/lib/python3.10/site-packages/huggingface_hub/utils/_validators.py", line 118, in _inner_fn
    return fn(*args, **kwargs)
  File "/home/pai/envs/opencompass/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 1364, in hf_hub_download
    http_get(
  File "/home/pai/envs/opencompass/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 505, in http_get
    r = _request_wrapper(
  File "/home/pai/envs/opencompass/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 442, in _request_wrapper
    return http_backoff(
  File "/home/pai/envs/opencompass/lib/python3.10/site-packages/huggingface_hub/utils/_http.py", line 258, in http_backoff
    response = session.request(method=method, url=url, **kwargs)
      File "/home/pai/envs/opencompass/lib/python3.10/site-packages/requests/sessions.py", line 589, in request
    resp = self.send(prep, **send_kwargs)
  File "/home/pai/envs/opencompass/lib/python3.10/site-packages/requests/sessions.py", line 703, in send
    r = adapter.send(request, **kwargs)
  File "/home/pai/envs/opencompass/lib/python3.10/site-packages/huggingface_hub/utils/_http.py", line 63, in send
    return super().send(request, *args, **kwargs)
  File "/home/pai/envs/opencompass/lib/python3.10/site-packages/requests/adapters.py", line 517, in send
    raise SSLError(e, request=request)
requests.exceptions.SSLError: (MaxRetryError("HTTPSConnectionPool(host='cdn-lfs.huggingface.co', port=443): Max retries exceeded with url: /repos/41/79/4179336a0fd236024c42cf139f37d87e81cdc11dd2be9f7c4d5fb870edc3b3cd/2d74da6615135c58cf3cf9ad4cb11e7c613ff9e55fe658a47ab83b6c8d1174a9?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27pytorch_model.bin%3B+filename%3D%22pytorch_model.bin%22%3B&response-content-type=application%2Foctet-stream&Expires=1694675392&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTY5NDY3NTM5Mn19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy5odWdnaW5nZmFjZS5jby9yZXBvcy80MS83OS80MTc5MzM2YTBmZDIzNjAyNGM0MmNmMTM5ZjM3ZDg3ZTgxY2RjMTFkZDJiZTlmN2M0ZDVmYjg3MGVkYzNiM2NkLzJkNzRkYTY2MTUxMzVjNThjZjNjZjlhZDRjYjExZTdjNjEzZmY5ZTU1ZmU2NThhNDdhYjgzYjZjOGQxMTc0YTk~cmVzcG9uc2UtY29udGVudC1kaXNwb3NpdGlvbj0qJnJlc3BvbnNlLWNvbnRlbnQtdHlwZT0qIn1dfQ__&Signature=Y9cah7pD~j5P-Ra45TSUDcrstC1emxJYJAd6STrfzXR4k9EURl~ldAzEX-VJHj8yLBVUWpnakvDgAeix~wmZPqH5PEPTOxhtFIda-omIG5CMn5zZxv6ny~3pVBCN2hVGl1Hel-dMdDmAxJFXGV7yzC1tJjG4P5-iA1K5qpf1NAfPs8UdlJlZao3~aZBWUMQPis27mt78eZN7xyNVJaW-SAkldEbNxmOkGbB-FNfSswAbtyelwP8jWPn-nVzQacONNSijMl5DLn3eZ3hRDs3F00BMReqhSuYwnZuUF9jVRF2qs76SXt0ykoosG8~gwHubjfvENJbOnpeXhrUXuvDiKQ__&Key-Pair-Id=KVTP0A1DKRTAX (Caused by SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1007)')))"), '(Request ID: 7b380824-2c4b-4323-ba50-02cd9529d0d0)')
ERROR:torch.distributed.elastic.multiprocessing.api:failed (exitcode: 1) local_rank: 0 (pid: 190247) of binary: /home/pai/envs/opencompass/bin/python
Traceback (most recent call last):
  File "/home/pai/envs/opencompass/bin/torchrun", line 33, in <module>
    sys.exit(load_entry_point('torch==2.0.1', 'console_scripts', 'torchrun')())
  File "/home/pai/envs/opencompass/lib/python3.10/site-packages/torch/distributed/elastic/multiprocessing/errors/__init__.py", line 346, in wrapper
      return f(*args, **kwargs)
  File "/home/pai/envs/opencompass/lib/python3.10/site-packages/torch/distributed/run.py", line 794, in main
    run(args)
  File "/home/pai/envs/opencompass/lib/python3.10/site-packages/torch/distributed/run.py", line 785, in run
    elastic_launch(
  File "/home/pai/envs/opencompass/lib/python3.10/site-packages/torch/distributed/launcher/api.py", line 134, in __call__
    return launch_agent(self._config, self._entrypoint, list(args))
  File "/home/pai/envs/opencompass/lib/python3.10/site-packages/torch/distributed/launcher/api.py", line 250, in launch_agent
    raise ChildFailedError(
torch.distributed.elastic.multiprocessing.errors.ChildFailedError:
============================================================
/root/opencompass/opencompass/tasks/openicl_infer.py FAILED
------------------------------------------------------------
Failures:
  <NO_OTHER_FAILURES>
------------------------------------------------------------
Root Cause (first observed failure):
[0]:
  time      : 2023-09-11_15:09:53
  host      : dsw-32496-5b9c55db9c-g7np5
  rank      : 0 (local_rank: 0)
  exitcode  : 1 (pid: 190247)
  error_file: <N/A>
  traceback : To enable traceback see: https://pytorch.org/docs/stable/elastic/errors.html
============================================================
```

> urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='cdn-lfs.huggingface.co', port=443): Max retries exceeded with url:

It seems HuggingFace cannot be reached through your network. Please check your connection or work behind a proxy server.

We will add this case into our FAQ, thanks for notifying us.

感谢，建议下次把错误类型report出来，hhh

遇到了类似的错误
![image](https://github.com/open-compass/opencompass/assets/151140797/75839300-cc65-430b-a9cf-c10cf51c4c76)
04/25 11:16:37 - OpenCompass - ERROR - /root/opencompass/opencompass/tasks/openicl_eval.py - _score - 238 - Task [opencompass.models.huggingface.HuggingFace_Shanghai_AI_Laboratory_internlm2-chat-1_8b/ceval-chinese_language_and_literature]: No predictions found.
04/25 11:16:40 - OpenCompass - ERROR - /root/opencompass/opencompass/tasks/openicl_eval.py - _score - 238 - Task [opencompass.models.huggingface.HuggingFace_Shanghai_AI_Laboratory_internlm2-chat-1_8b/ceval-art_studies]: No predictions found.
04/25 11:16:42 - OpenCompass - ERROR - /root/opencompass/opencompass/tasks/openicl_eval.py - _score - 238 - Task [opencompass.models.huggingface.HuggingFace_Shanghai_AI_Laboratory_internlm2-chat-1_8b/ceval-professional_tour_guide]: No predictions found.
04/25 11:16:44 - OpenCompass - ERROR - /root/opencompass/opencompass/tasks/openicl_eval.py - _score - 238 - Task [opencompass.models.huggingface.HuggingFace_Shanghai_AI_Laboratory_internlm2-chat-1_8b/ceval-legal_professional]: No predictions found.
04/25 11:16:46 - OpenCompass - ERROR - /root/opencompass/opencompass/tasks/openicl_eval.py - _score - 238 - Task [opencompass.models.huggingface.HuggingFace_Shanghai_AI_Laboratory_internlm2-chat-1_8b/ceval-high_school_chinese]: No predictions found.
04/25 11:16:48 - OpenCompass - ERROR - /root/opencompass/opencompass/tasks/openicl_eval.py - _score - 238 - Task [opencompass.models.huggingface.HuggingFace_Shanghai_AI_Laboratory_internlm2-chat-1_8b/ceval-high_school_history]: No predictions found.
04/25 11:16:50 - OpenCompass - ERROR - /root/opencompass/opencompass/tasks/openicl_eval.py - _score - 238 - Task [opencompass.models.huggingface.HuggingFace_Shanghai_AI_Laboratory_internlm2-chat-1_8b/ceval-middle_school_history]: No predictions found.
04/25 11:16:52 - OpenCompass - ERROR - /root/opencompass/opencompass/tasks/openicl_eval.py - _score - 238 - Task [opencompass.models.huggingface.HuggingFace_Shanghai_AI_Laboratory_internlm2-chat-1_8b/ceval-civil_servant]: No predictions found.
04/25 11:16:54 - OpenCompass - ERROR - /root/opencompass/opencompass/tasks/openicl_eval.py - _score - 238 - Task [opencompass.models.huggingface.HuggingFace_Shanghai_AI_Laboratory_internlm2-chat-1_8b/ceval-sports_science]: No predictions found.
04/25 11:16:56 - OpenCompass - ERROR - /root/opencompass/opencompass/tasks/openicl_eval.py - _score - 238 - Task [opencompass.models.huggingface.HuggingFace_Shanghai_AI_Laboratory_internlm2-chat-1_8b/ceval-plant_protection]: No predictions found.
04/25 11:16:58 - OpenCompass - ERROR - /root/opencompass/opencompass/tasks/openicl_eval.py - _score - 238 - Task [opencompass.models.huggingface.HuggingFace_Shanghai_AI_Laboratory_internlm2-chat-1_8b/ceval-basic_medicine]: No predictions found.
04/25 11:17:01 - OpenCompass - ERROR - /root/opencompass/opencompass/tasks/openicl_eval.py - _score - 238 - Task [opencompass.models.huggingface.HuggingFace_Shanghai_AI_Laboratory_internlm2-chat-1_8b/ceval-clinical_medicine]: No predictions found.
04/25 11:17:03 - OpenCompass - ERROR - /root/opencompass/opencompass/tasks/openicl_eval.py - _score - 238 - Task [opencompass.models.huggingface.HuggingFace_Shanghai_AI_Laboratory_internlm2-chat-1_8b/ceval-urban_and_rural_planner]: No predictions found.
04/25 11:17:05 - OpenCompass - ERROR - /root/opencompass/opencompass/tasks/openicl_eval.py - _score - 238 - Task [opencompass.models.huggingface.HuggingFace_Shanghai_AI_Laboratory_internlm2-chat-1_8b/ceval-accountant]: No predictions found.
04/25 11:17:07 - OpenCompass - ERROR - /root/opencompass/opencompass/tasks/openicl_eval.py - _score - 238 - Task [opencompass.models.huggingface.HuggingFace_Shanghai_AI_Laboratory_internlm2-chat-1_8b/ceval-fire_engineer]: No predictions found.
04/25 11:17:09 - OpenCompass - ERROR - /root/opencompass/opencompass/tasks/openicl_eval.py - _score - 238 - Task [opencompass.models.huggingface.HuggingFace_Shanghai_AI_Laboratory_internlm2-chat-1_8b/ceval-environmental_impact_assessment_engineer]: No predictions found.
04/25 11:17:11 - OpenCompass - ERROR - /root/opencompass/opencompass/tasks/openicl_eval.py - _score - 238 - Task [opencompass.models.huggingface.HuggingFace_Shanghai_AI_Laboratory_internlm2-chat-1_8b/ceval-tax_accountant]: No predictions found.
04/25 11:17:13 - OpenCompass - ERROR - /root/opencompass/opencompass/tasks/openicl_eval.py - _score - 238 - Task [opencompass.models.huggingface.HuggingFace_Shanghai_AI_Laboratory_internlm2-chat-1_8b/ceval-physician]: No predictions found.

> 遇到了类似的错误 ![image](https://private-user-images.githubusercontent.com/151140797/325462632-75839300-cc65-430b-a9cf-c10cf51c4c76.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTczMTAzMzQsIm5iZiI6MTcxNzMxMDAzNCwicGF0aCI6Ii8xNTExNDA3OTcvMzI1NDYyNjMyLTc1ODM5MzAwLWNjNjUtNDMwYi1hOWNmLWMxMGNmNTFjNGM3Ni5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjQwNjAyJTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI0MDYwMlQwNjMzNTRaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT1kODkwYjhjOTMxZjA5NGUwNzFjZWRmZmVhZGY1MDlhNDdiMDY1ZGYyNDU5NTM3NTM0ZTU2YWYwMjc4NmU1Y2IxJlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCZhY3Rvcl9pZD0wJmtleV9pZD0wJnJlcG9faWQ9MCJ9.E62L4D5Yoz_sIXPDtqkMUYcnL6dHZ-sJuBkH6yZqcpM) 04/25 11:16:37 - OpenCompass - ERROR - /root/opencompass/opencompass/tasks/openicl_eval.py - _score - 238 - Task [opencompass.models.huggingface.HuggingFace_Shanghai_AI_Laboratory_internlm2-chat-1_8b/ceval-chinese_language_and_literature]: No predictions found. 04/25 11:16:40 - OpenCompass - ERROR - /root/opencompass/opencompass/tasks/openicl_eval.py - _score - 238 - Task [opencompass.models.huggingface.HuggingFace_Shanghai_AI_Laboratory_internlm2-chat-1_8b/ceval-art_studies]: No predictions found. 04/25 11:16:42 - OpenCompass - ERROR - /root/opencompass/opencompass/tasks/openicl_eval.py - _score - 238 - Task [opencompass.models.huggingface.HuggingFace_Shanghai_AI_Laboratory_internlm2-chat-1_8b/ceval-professional_tour_guide]: No predictions found. 04/25 11:16:44 - OpenCompass - ERROR - /root/opencompass/opencompass/tasks/openicl_eval.py - _score - 238 - Task [opencompass.models.huggingface.HuggingFace_Shanghai_AI_Laboratory_internlm2-chat-1_8b/ceval-legal_professional]: No predictions found. 04/25 11:16:46 - OpenCompass - ERROR - /root/opencompass/opencompass/tasks/openicl_eval.py - _score - 238 - Task [opencompass.models.huggingface.HuggingFace_Shanghai_AI_Laboratory_internlm2-chat-1_8b/ceval-high_school_chinese]: No predictions found. 04/25 11:16:48 - OpenCompass - ERROR - /root/opencompass/opencompass/tasks/openicl_eval.py - _score - 238 - Task [opencompass.models.huggingface.HuggingFace_Shanghai_AI_Laboratory_internlm2-chat-1_8b/ceval-high_school_history]: No predictions found. 04/25 11:16:50 - OpenCompass - ERROR - /root/opencompass/opencompass/tasks/openicl_eval.py - _score - 238 - Task [opencompass.models.huggingface.HuggingFace_Shanghai_AI_Laboratory_internlm2-chat-1_8b/ceval-middle_school_history]: No predictions found. 04/25 11:16:52 - OpenCompass - ERROR - /root/opencompass/opencompass/tasks/openicl_eval.py - _score - 238 - Task [opencompass.models.huggingface.HuggingFace_Shanghai_AI_Laboratory_internlm2-chat-1_8b/ceval-civil_servant]: No predictions found. 04/25 11:16:54 - OpenCompass - ERROR - /root/opencompass/opencompass/tasks/openicl_eval.py - _score - 238 - Task [opencompass.models.huggingface.HuggingFace_Shanghai_AI_Laboratory_internlm2-chat-1_8b/ceval-sports_science]: No predictions found. 04/25 11:16:56 - OpenCompass - ERROR - /root/opencompass/opencompass/tasks/openicl_eval.py - _score - 238 - Task [opencompass.models.huggingface.HuggingFace_Shanghai_AI_Laboratory_internlm2-chat-1_8b/ceval-plant_protection]: No predictions found. 04/25 11:16:58 - OpenCompass - ERROR - /root/opencompass/opencompass/tasks/openicl_eval.py - _score - 238 - Task [opencompass.models.huggingface.HuggingFace_Shanghai_AI_Laboratory_internlm2-chat-1_8b/ceval-basic_medicine]: No predictions found. 04/25 11:17:01 - OpenCompass - ERROR - /root/opencompass/opencompass/tasks/openicl_eval.py - _score - 238 - Task [opencompass.models.huggingface.HuggingFace_Shanghai_AI_Laboratory_internlm2-chat-1_8b/ceval-clinical_medicine]: No predictions found. 04/25 11:17:03 - OpenCompass - ERROR - /root/opencompass/opencompass/tasks/openicl_eval.py - _score - 238 - Task [opencompass.models.huggingface.HuggingFace_Shanghai_AI_Laboratory_internlm2-chat-1_8b/ceval-urban_and_rural_planner]: No predictions found. 04/25 11:17:05 - OpenCompass - ERROR - /root/opencompass/opencompass/tasks/openicl_eval.py - _score - 238 - Task [opencompass.models.huggingface.HuggingFace_Shanghai_AI_Laboratory_internlm2-chat-1_8b/ceval-accountant]: No predictions found. 04/25 11:17:07 - OpenCompass - ERROR - /root/opencompass/opencompass/tasks/openicl_eval.py - _score - 238 - Task [opencompass.models.huggingface.HuggingFace_Shanghai_AI_Laboratory_internlm2-chat-1_8b/ceval-fire_engineer]: No predictions found. 04/25 11:17:09 - OpenCompass - ERROR - /root/opencompass/opencompass/tasks/openicl_eval.py - _score - 238 - Task [opencompass.models.huggingface.HuggingFace_Shanghai_AI_Laboratory_internlm2-chat-1_8b/ceval-environmental_impact_assessment_engineer]: No predictions found. 04/25 11:17:11 - OpenCompass - ERROR - /root/opencompass/opencompass/tasks/openicl_eval.py - _score - 238 - Task [opencompass.models.huggingface.HuggingFace_Shanghai_AI_Laboratory_internlm2-chat-1_8b/ceval-tax_accountant]: No predictions found. 04/25 11:17:13 - OpenCompass - ERROR - /root/opencompass/opencompass/tasks/openicl_eval.py - _score - 238 - Task [opencompass.models.huggingface.HuggingFace_Shanghai_AI_Laboratory_internlm2-chat-1_8b/ceval-physician]: No predictions found.

请问你解决了吗，我也是遇到了这个问题No predictions found

Check this out, [我解决了torchrun环境异常情况下的No predictions found问题. ](https://github.com/open-compass/opencompass/discussions/1370#discussion-6984033)