Repository: open-compass/opencompass
Issue: [Bug] BBH demo command gives an error
Root cause: External Dependency Breakage

### Prerequisite

- [X] I have searched [Issues](https://github.com/open-compass/opencompass/issues/) and [Discussions](https://github.com/open-compass/opencompass/discussions) but cannot get the expected help.
- [X] The bug has not been fixed in the [latest version](https://github.com/open-compass/opencompass).

### Type

I'm evaluating with the officially supported tasks/models/datasets.

### Environment

{'CUDA available': False,
 'GCC': 'gcc (GCC) 7.3.1 20180712 (Red Hat 7.3.1-17)',
 'MMEngine': '0.10.5',
 'MUSA available': False,
 'OpenCV': '4.10.0',
 'PyTorch': '2.4.0+cu121',
 'PyTorch compiling details': 'PyTorch built with:\n'
                              '  - GCC 9.3\n'
                              '  - C++ Version: 201703\n'
                              '  - Intel(R) oneAPI Math Kernel Library Version '
                              '2022.2-Product Build 20220804 for Intel(R) 64 '
                              'architecture applications\n'
                              '  - Intel(R) MKL-DNN v3.4.2 (Git Hash '
                              '1137e04ec0b5251ca2b4400a4fd3c667ce843d67)\n'
                              '  - OpenMP 201511 (a.k.a. OpenMP 4.5)\n'
                              '  - LAPACK is enabled (usually provided by '
                              'MKL)\n'
                              '  - NNPACK is enabled\n'
                              '  - CPU capability usage: AVX512\n'
                              '  - Build settings: BLAS_INFO=mkl, '
                              'BUILD_TYPE=Release, CUDA_VERSION=12.1, '
                              'CUDNN_VERSION=9.1.0, '
                              'CXX_COMPILER=/opt/rh/devtoolset-9/root/usr/bin/c++, '
                              'CXX_FLAGS= -D_GLIBCXX_USE_CXX11_ABI=0 '
                              '-fabi-version=11 -fvisibility-inlines-hidden '
                              '-DUSE_PTHREADPOOL -DNDEBUG -DUSE_KINETO '
                              '-DLIBKINETO_NOROCTRACER -DUSE_FBGEMM '
                              '-DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK '
                              '-DSYMBOLICATE_MOBILE_DEBUG_HANDLE -O2 -fPIC '
                              '-Wall -Wextra -Werror=return-type '
                              '-Werror=non-virtual-dtor -Werror=bool-operation '
                              '-Wnarrowing -Wno-missing-field-initializers '
                              '-Wno-type-limits -Wno-array-bounds '
                              '-Wno-unknown-pragmas -Wno-unused-parameter '
                              '-Wno-unused-function -Wno-unused-result '
                              '-Wno-strict-overflow -Wno-strict-aliasing '
                              '-Wno-stringop-overflow -Wsuggest-override '
                              '-Wno-psabi -Wno-error=pedantic '
                              '-Wno-error=old-style-cast -Wno-missing-braces '
                              '-fdiagnostics-color=always -faligned-new '
                              '-Wno-unused-but-set-variable '
                              '-Wno-maybe-uninitialized -fno-math-errno '
                              '-fno-trapping-math -Werror=format '
                              '-Wno-stringop-overflow, LAPACK_INFO=mkl, '
                              'PERF_WITH_AVX=1, PERF_WITH_AVX2=1, '
                              'PERF_WITH_AVX512=1, TORCH_VERSION=2.4.0, '
                              'USE_CUDA=ON, USE_CUDNN=ON, USE_CUSPARSELT=1, '
                              'USE_EXCEPTION_PTR=1, USE_GFLAGS=OFF, '
                              'USE_GLOG=OFF, USE_GLOO=ON, USE_MKL=ON, '
                              'USE_MKLDNN=ON, USE_MPI=OFF, USE_NCCL=1, '
                              'USE_NNPACK=ON, USE_OPENMP=ON, USE_ROCM=OFF, '
                              'USE_ROCM_KERNEL_ASSERT=OFF, \n',
 'Python': '3.12.7 | packaged by Anaconda, Inc. | (main, Oct  4 2024, '
           '13:27:36) [GCC 11.2.0]',
 'TorchVision': '0.19.0+cu121',
 'lmdeploy': "not installed:No module named 'lmdeploy'",
 'numpy_random_seed': 2147483648,
 'opencompass': '0.3.4+98406a1',
 'sys.platform': 'linux',
 'transformers': '4.46.1'}


### Reproduces the problem - code/configuration sample

python opencompass/run.py --models hf_internlm2_7b --datasets bbh_gen_98fba6 --dry-run

### Reproduces the problem - command or script

python opencompass/run.py --models hf_internlm2_7b --datasets bbh_gen_98fba6 --dry-run

### Reproduces the problem - error message

11/01 17:30:29 - OpenCompass - INFO - Loading bbh_gen_98fba6: /fsx/users/ylizam/System2Alignment/opencompass/opencompass/configs/./datasets/bbh/bbh_gen_98fba6.py
Traceback (most recent call last):
  File "/fsx/users/ylizam/System2Alignment/opencompass/run.py", line 4, in <module>
    main()
  File "/fsx/users/ylizam/System2Alignment/opencompass/opencompass/cli/main.py", line 227, in main
    cfg = get_config_from_arg(args)
          ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/fsx/users/ylizam/System2Alignment/opencompass/opencompass/utils/run.py", line 139, in get_config_from_arg
    cfg = Config.fromfile(dataset[1])
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/fsx/users/ylizam/miniconda3/envs/system2/lib/python3.12/site-packages/mmengine/config/config.py", line 494, in fromfile
    raise e
  File "/fsx/users/ylizam/miniconda3/envs/system2/lib/python3.12/site-packages/mmengine/config/config.py", line 492, in fromfile
    cfg_dict, imported_names = Config._parse_lazy_import(filename)
                               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/fsx/users/ylizam/miniconda3/envs/system2/lib/python3.12/site-packages/mmengine/config/config.py", line 1109, in _parse_lazy_import
    exec(
  File "/fsx/users/ylizam/System2Alignment/opencompass/opencompass/configs/./datasets/bbh/bbh_gen_98fba6.py", line 44, in <module>
    with open(os.path.join(os.path.dirname(__file__), 'lib_prompt', f'{_name}.txt'), 'r') as f:
                           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/fsx/users/ylizam/miniconda3/envs/system2/lib/python3.12/site-packages/mmengine/config/lazy.py", line 205, in __call__
    raise RuntimeError()
RuntimeError

### Other information

_No response_

Please enter the opencompass folder, `python run.py --models hf_internlm2_7b --datasets bbh_gen_98fba6 --dry-run` or use `opencompass --models hf_internlm2_7b --datasets bbh_gen_98fba6 --dry-run`

I have tested the latest commit with `python run.py --models hf_internlm2_7b --datasets bbh_gen_98fba6 --dry-run`, it works well. Feel free to re-open if you have more question~

Thanks for taking a look,  but I tried the two commands you shared above and they both give errors. It's able to find the correct config file, but the error occurs when trying to load the config with `Config.from_file()`, where it complains about `with open(os.path.join(os.path.dirname(__file__), 'lib_prompt', f'{_name}.txt'), 'r') as f:`. It somehow invoke the lazy loader and gives RuntimeError. 

I'm wondering if this could be something wrong with mmengine. Can you check which version of mmengine you used?

``` 
mmengine-lite                     0.10.4
```

can you solved this problem?

can you solved this problem?