Repository: open-compass/opencompass
Issue: [Bug] 为什么按官方文档跑会报错？
Root cause: Environment Incompatibility

### Prerequisite

- [X] I have searched [Issues](https://github.com/open-compass/opencompass/issues/) and [Discussions](https://github.com/open-compass/opencompass/discussions) but cannot get the expected help.
- [X] The bug has not been fixed in the [latest version](https://github.com/open-compass/opencompass).

### Type

I'm evaluating with the officially supported tasks/models/datasets.

### Environment

{'CUDA available': True,
 'CUDA_HOME': None,
 'GCC': 'n/a',
 'GPU 0,1': 'NVIDIA GeForce RTX 3090',
 'MMEngine': '0.10.2',
 'OpenCV': '4.9.0',
 'PyTorch': '2.1.2',
 'PyTorch compiling details': 'PyTorch built with:\n'
                              '  - C++ Version: 199711\n'
                              '  - MSVC 192930151\n'
                              '  - Intel(R) Math Kernel Library Version '
                              '2020.0.2 Product Build 20200624 for Intel(R) 64 '
                              'architecture applications\n'
                              '  - Intel(R) MKL-DNN v3.1.1 (Git Hash '
                              '64f6bcbcbab628e96f33a62c3e975f8535a7bde4)\n'
                              '  - OpenMP 2019\n'
                              '  - LAPACK is enabled (usually provided by '
                              'MKL)\n'
                              '  - CPU capability usage: AVX2\n'
                              '  - CUDA Runtime 12.1\n'
                              '  - NVCC architecture flags: '
                              '-gencode;arch=compute_50,code=sm_50;-gencode;arch=compute_60,
code=sm_60;-gencode;arch=compute_61,code=sm_61;-gencode;arch=compute_70,code=sm_70;-gencode;
arch=compute_75,code=sm_75;-gencode;arch=compute_80,code=sm_80;-gencode;arch=compute_86,code
=sm_86;-gencode;arch=compute_90,code=sm_90\n'
                              '  - CuDNN 8.8.1  (built against CUDA 12.0)\n'
                              '  - Magma 2.5.4\n'
                              '  - Build settings: BLAS_INFO=mkl, '
                              'BUILD_TYPE=Release, CUDA_VERSION=12.1, '
                              'CUDNN_VERSION=8.8.1, '
                              'CXX_COMPILER=C:/cb/pytorch_1000000000000/work/tmp_bin/sccache
-cl.exe, '
                              'CXX_FLAGS=/DWIN32 /D_WINDOWS /GR /EHsc /bigobj '
                              '/FS -DUSE_PTHREADPOOL -DNDEBUG -DUSE_KINETO '
                              '-DLIBKINETO_NOCUPTI -DLIBKINETO_NOROCTRACER '
                              '-DUSE_FBGEMM -DUSE_XNNPACK '
                              '-DSYMBOLICATE_MOBILE_DEBUG_HANDLE /utf-8 '
                              '/wd4624 /wd4068 /wd4067 /wd4267 /wd4661 /wd4717 '
                              '/wd4244 /wd4804 /wd4273, LAPACK_INFO=mkl, '
                              'PERF_WITH_AVX=1, PERF_WITH_AVX2=1, '
                              'PERF_WITH_AVX512=1, '
                              'TORCH_DISABLE_GPU_ASSERTS=OFF, '
                              'TORCH_VERSION=2.1.2, USE_CUDA=ON, USE_CUDNN=ON, '
                              'USE_EXCEPTION_PTR=1, USE_GFLAGS=OFF, '
                              'USE_GLOG=OFF, USE_MKL=ON, USE_MKLDNN=ON, '
                              'USE_MPI=OFF, USE_NCCL=OFF, USE_NNPACK=OFF, '
                              'USE_OPENMP=ON, USE_ROCM=OFF, \n',
 'Python': '3.10.13 | packaged by Anaconda, Inc. | (main, Sep 11 2023, '
           '13:24:38) [MSC v.1916 64 bit (AMD64)]',
 'TorchVision': '0.16.2',
 'numpy_random_seed': 2147483648,
 'opencompass': '0.2.1+unknown',
 'sys.platform': 'win32'}

### Reproduces the problem - code/configuration sample

。

### Reproduces the problem - command or script

python run.py --models hf_opt_125m hf_opt_350m --datasets siqa_gen winograd_ppl

### Reproduces the problem - error message

01/15 17:48:08 - OpenCompass - INFO - Loading siqa_gen: configs\datasets\siqa\siqa_gen.py
01/15 17:48:08 - OpenCompass - INFO - Loading winograd_ppl: configs\datasets\winograd\winogr
ad_ppl.py
01/15 17:48:08 - OpenCompass - INFO - Loading hf_opt_125m: configs\models\opt\hf_opt_125m.py
01/15 17:48:08 - OpenCompass - INFO - Loading hf_opt_350m: configs\models\opt\hf_opt_350m.py
01/15 17:48:08 - OpenCompass - INFO - Loading example: configs\summarizers\example.py       
01/15 17:48:08 - OpenCompass - WARNING - SlurmRunner is not used, so the partition argument 
is ignored.
01/15 17:48:08 - OpenCompass - INFO - Partitioned into 2 tasks.
launch OpenICLInfer[opt125m/siqa,opt125m/winograd] on GPU 0
launch OpenICLInfer[opt350m/siqa,opt350m/winograd] on GPU 1
100%|████████████████████████████████████████████████████████| 2/2 [00:02<00:00,  1.43s/it] 
01/15 17:48:11 - OpenCompass - INFO - Partitioned into 4 tasks.
launch OpenICLEval[opt125m/siqa] on CPU
launch OpenICLEval[opt125m/winograd] on CPU
launch OpenICLEval[opt350m/siqa] on CPU 
launch OpenICLEval[opt350m/winograd] on CPU 
  0%|                                                                | 0/4 [00:00<?, ?it/s]0
1/15 17:48:17 - OpenCompass - WARNING - task OpenICLEval[opt350m/siqa] fail, see
./outputs/default/20240115_174808\logs/eval\opt350m\siqa.out
01/15 17:48:17 - OpenCompass - WARNING - task OpenICLEval[opt350m/winograd] fail, see
./outputs/default/20240115_174808\logs/eval\opt350m\winograd.out
 25%|██████████████                                          | 1/4 [00:05<00:17,  5.79s/it]0
1/15 17:48:17 - OpenCompass - WARNING - task OpenICLEval[opt125m/siqa] fail, see
./outputs/default/20240115_174808\logs/eval\opt125m\siqa.out
01/15 17:48:17 - OpenCompass - WARNING - task OpenICLEval[opt125m/winograd] fail, see       
./outputs/default/20240115_174808\logs/eval\opt125m\winograd.out
100%|████████████████████████████████████████████████████████| 4/4 [00:05<00:00,  1.45s/it] 
01/15 17:48:17 - OpenCompass - ERROR - C:\Users\Ling\Desktop\opencompass\opencompass\runners
\base.py - summarize - 63 - OpenICLEval[opt125m/siqa] failed with code 9009
01/15 17:48:17 - OpenCompass - ERROR - C:\Users\Ling\Desktop\opencompass\opencompass\runners
\base.py - summarize - 63 - OpenICLEval[opt125m/winograd] failed with code 9009
01/15 17:48:17 - OpenCompass - ERROR - C:\Users\Ling\Desktop\opencompass\opencompass\runners
\base.py - summarize - 63 - OpenICLEval[opt350m/siqa] failed with code 9009
01/15 17:48:17 - OpenCompass - ERROR - C:\Users\Ling\Desktop\opencompass\opencompass\runners
\base.py - summarize - 63 - OpenICLEval[opt350m/winograd] failed with code 9009
dataset    version    metric    mode    opt125m    opt350m
---------  ---------  --------  ------  ---------  ---------
siqa       -          -         -       -          -
winograd   -          -         -       -          -
01/15 17:48:17 - OpenCompass - INFO - write summary to C:\Users\Ling\Desktop\opencompass\out
puts\default\20240115_174808\summary\summary_20240115_174808.txt
01/15 17:48:17 - OpenCompass - INFO - write csv to C:\Users\Ling\Desktop\opencompass\outputs
\default\20240115_174808\summary\summary_20240115_174808.csv

### Other information

完全安装官方文档操作，报错是什么原因呢？

Please check `./outputs/default/20240115_174808\logs/eval\opt350m\siqa.out` or use --debug

./outputs/default/20240115_174808\logs/eval\opt350m\siqa.out 是空文件

(opencompass) PS C:\Users\Ling\Desktop\opencompass> python run.py --models hf_opt_125m hf_opt_350
m --datasets siqa_gen winograd_ppl --debug
01/15 18:29:49 - OpenCompass - INFO - Loading siqa_gen: configs\datasets\siqa\siqa_gen.py
01/15 18:29:49 - OpenCompass - INFO - Loading winograd_ppl: configs\datasets\winograd\winograd_pp
l.py
01/15 18:29:49 - OpenCompass - INFO - Loading hf_opt_125m: configs\models\opt\hf_opt_125m.py     
01/15 18:29:49 - OpenCompass - INFO - Loading hf_opt_350m: configs\models\opt\hf_opt_350m.py     
01/15 18:29:49 - OpenCompass - INFO - Loading example: configs\summarizers\example.py
01/15 18:29:50 - OpenCompass - WARNING - SlurmRunner is not used, so the partition argument is ig
nored.
01/15 18:29:50 - OpenCompass - DEBUG - Modules of opencompass's partitioner registry have been au
tomatically imported from opencompass.partitioners
01/15 18:29:50 - OpenCompass - DEBUG - Get class `SizePartitioner` from "partitioner" registry in
 "opencompass"
01/15 18:29:50 - OpenCompass - DEBUG - An `SizePartitioner` instance is built from registry, and 
its implementation can be found in opencompass.partitioners.size
01/15 18:29:50 - OpenCompass - DEBUG - Key eval.runner.task.judge_cfg not found in config, ignore
d.
01/15 18:29:50 - OpenCompass - DEBUG - Key eval.runner.task.dump_details not found in config, ign
ored.
01/15 18:29:50 - OpenCompass - DEBUG - Additional config: {}
01/15 18:29:50 - OpenCompass - INFO - Partitioned into 2 tasks.
01/15 18:29:50 - OpenCompass - DEBUG - Task 0: [opt125m/siqa,opt125m/winograd]
01/15 18:29:50 - OpenCompass - DEBUG - Task 1: [opt350m/siqa,opt350m/winograd]
01/15 18:29:50 - OpenCompass - DEBUG - Modules of opencompass's runner registry have been automat
ically imported from opencompass.runners
01/15 18:29:50 - OpenCompass - DEBUG - Get class `LocalRunner` from "runner" registry in "opencom
pass"
01/15 18:29:50 - OpenCompass - DEBUG - An `LocalRunner` instance is built from registry, and its 
implementation can be found in opencompass.runners.local
01/15 18:29:50 - OpenCompass - DEBUG - Modules of opencompass's task registry have been automatic
ally imported from opencompass.tasks
01/15 18:29:50 - OpenCompass - DEBUG - Get class `OpenICLInferTask` from "task" registry in "open
compass"
01/15 18:29:50 - OpenCompass - DEBUG - An `OpenICLInferTask` instance is built from registry, and
 its implementation can be found in opencompass.tasks.openicl_infer
01/15 18:29:51 - OpenCompass - WARNING - Only use 1 GPUs for total 2 available GPUs in debug mode
.
failed to create process.
01/15 18:29:51 - OpenCompass - DEBUG - Get class `OpenICLInferTask` from "task" registry in "open
compass"
01/15 18:29:51 - OpenCompass - DEBUG - An `OpenICLInferTask` instance is built from registry, and
 its implementation can be found in opencompass.tasks.openicl_infer
failed to create process.
01/15 18:29:52 - OpenCompass - DEBUG - Get class `NaivePartitioner` from "partitioner" registry i
n "opencompass"
01/15 18:29:52 - OpenCompass - DEBUG - An `NaivePartitioner` instance is built from registry, and
 its implementation can be found in opencompass.partitioners.naive
01/15 18:29:52 - OpenCompass - DEBUG - Key eval.runner.task.judge_cfg not found in config, ignore
d.
01/15 18:29:52 - OpenCompass - DEBUG - Key eval.runner.task.dump_details not found in config, ign
ored.
01/15 18:29:52 - OpenCompass - DEBUG - Additional config: {'eval': {'runner': {'task': {}}}}     
01/15 18:29:52 - OpenCompass - INFO - Partitioned into 4 tasks.
01/15 18:29:52 - OpenCompass - DEBUG - Task 0: [opt125m/siqa]
01/15 18:29:52 - OpenCompass - DEBUG - Task 1: [opt125m/winograd]
01/15 18:29:52 - OpenCompass - DEBUG - Task 2: [opt350m/siqa]
01/15 18:29:52 - OpenCompass - DEBUG - Task 3: [opt350m/winograd]
01/15 18:29:52 - OpenCompass - DEBUG - Get class `LocalRunner` from "runner" registry in "opencom
pass"
01/15 18:29:52 - OpenCompass - DEBUG - An `LocalRunner` instance is built from registry, and its 
implementation can be found in opencompass.runners.local
01/15 18:29:52 - OpenCompass - DEBUG - Get class `OpenICLEvalTask` from "task" registry in "openc
ompass"
01/15 18:29:52 - OpenCompass - DEBUG - An `OpenICLEvalTask` instance is built from registry, and 
its implementation can be found in opencompass.tasks.openicl_eval
01/15 18:29:54 - OpenCompass - DEBUG - Get class `OpenICLEvalTask` from "task" registry in "openc
ompass"
01/15 18:29:54 - OpenCompass - DEBUG - An `OpenICLEvalTask` instance is built from registry, and 
its implementation can be found in opencompass.tasks.openicl_eval
01/15 18:29:55 - OpenCompass - DEBUG - Get class `OpenICLEvalTask` from "task" registry in "openc
ompass"
01/15 18:29:55 - OpenCompass - DEBUG - An `OpenICLEvalTask` instance is built from registry, and 
its implementation can be found in opencompass.tasks.openicl_eval
01/15 18:29:57 - OpenCompass - DEBUG - Get class `OpenICLEvalTask` from "task" registry in "openc
ompass"
01/15 18:29:57 - OpenCompass - DEBUG - An `OpenICLEvalTask` instance is built from registry, and 
its implementation can be found in opencompass.tasks.openicl_eval
01/15 18:29:58 - OpenCompass - DEBUG - An `DefaultSummarizer` instance is built from registry, an
d its implementation can be found in opencompass.summarizers.default
dataset    version    metric    mode    opt125m    opt350m
---------  ---------  --------  ------  ---------  ---------
siqa       -          -         -       -          -
winograd   -          -         -       -          -
01/15 18:29:58 - OpenCompass - INFO - write summary to C:\Users\Ling\Desktop\opencompass\outputs\
default\20240115_182949\summary\summary_20240115_182949.txt
01/15 18:29:58 - OpenCompass - INFO - write csv to C:\Users\Ling\Desktop\opencompass\outputs\defa
ult\20240115_182949\summary\summary_20240115_182949.csv

We cannot guarantee the compatibility of the toolkit with Windows systems.

出现了相似的问题