Repository: open-compass/opencompass
Issue: [Bug] 主观评测alignbench评测错误
Root cause: Documentation Deficiency

### Prerequisite

- [x] I have searched [Issues](https://github.com/open-compass/opencompass/issues/) and [Discussions](https://github.com/open-compass/opencompass/discussions) but cannot get the expected help.
- [x] The bug has not been fixed in the [latest version](https://github.com/open-compass/opencompass).

### Type

I'm evaluating with the officially supported tasks/models/datasets.

### Environment

```
{'CUDA available': False,
 'GCC': 'gcc (Ubuntu 9.4.0-1ubuntu1~20.04.2) 9.4.0',
 'MMEngine': '0.10.6',
 'MUSA available': False,
 'OpenCV': '4.11.0',
 'PyTorch': '2.5.1',
 'PyTorch compiling details': 'PyTorch built with:\n'
                              '  - GCC 10.2\n'
                              '  - C++ Version: 201703\n'
                              '  - Intel(R) MKL-DNN v3.5.3 (Git Hash '
                              '66f0cb9eb66affd2da3bf5f8d897376f04aae6af)\n'
                              '  - OpenMP 201511 (a.k.a. OpenMP 4.5)\n'
                              '  - LAPACK is enabled (usually provided by '
                              'MKL)\n'
                              '  - NNPACK is enabled\n'
                              '  - CPU capability usage: NO AVX\n'
                              '  - Build settings: BLAS_INFO=open, '
                              'BUILD_TYPE=Release, '
                              'CXX_COMPILER=/opt/rh/devtoolset-10/root/usr/bin/c++, '
                              'CXX_FLAGS=-ffunction-sections -fdata-sections '
                              '-D_GLIBCXX_USE_CXX11_ABI=0 -fabi-version=11 '
                              '-fvisibility-inlines-hidden -DUSE_PTHREADPOOL '
                              '-DNDEBUG -DUSE_KINETO -DLIBKINETO_NOCUPTI '
                              '-DLIBKINETO_NOROCTRACER -DLIBKINETO_NOXPUPTI=ON '
                              '-DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK '
                              '-DSYMBOLICATE_MOBILE_DEBUG_HANDLE -O2 -fPIC '
                              '-Wall -Wextra -Werror=return-type '
                              '-Werror=non-virtual-dtor -Werror=bool-operation '
                              '-Wnarrowing -Wno-missing-field-initializers '
                              '-Wno-type-limits -Wno-array-bounds '
                              '-Wno-unknown-pragmas -Wno-unused-parameter '
                              '-Wno-strict-overflow -Wno-strict-aliasing '
                              '-Wno-stringop-overflow -Wsuggest-override '
                              '-Wno-psabi -Wno-error=old-style-cast '
                              '-Wno-missing-braces -fdiagnostics-color=always '
                              '-faligned-new -Wno-unused-but-set-variable '
                              '-Wno-maybe-uninitialized -fno-math-errno '
                              '-fno-trapping-math -Werror=format '
                              '-Wno-stringop-overflow, LAPACK_INFO=open, '
                              'TORCH_VERSION=2.5.1, USE_CUDA=OFF, '
                              'USE_CUDNN=OFF, USE_CUSPARSELT=OFF, '
                              'USE_EXCEPTION_PTR=1, USE_GFLAGS=OFF, '
                              'USE_GLOG=OFF, USE_GLOO=ON, USE_MKLDNN=ON, '
                              'USE_MPI=OFF, USE_NCCL=OFF, USE_NNPACK=ON, '
                              'USE_OPENMP=ON, USE_ROCM=OFF, '
                              'USE_ROCM_KERNEL_ASSERT=OFF, \n',
 'Python': '3.10.2 (main, Jan  8 2025, 06:13:36) [GCC 9.4.0]',
 'TorchVision': '0.20.1',
 'lmdeploy': "not installed:No module named 'lmdeploy'",
 'numpy_random_seed': 2147483648,
 'opencompass': '0.3.9+',
 'sys.platform': 'linux',
 'transformers': '4.51.3'}
```

### Reproduces the problem - code/configuration sample

登录官网发现alignbench数据集可从github处下载
但发现alignbench-github中只存在一个数据集，即: data/data_v1.1_release.jsonl
里面的键值对与SubjectiveCmpDataset明显对应不上，请问具体应该去哪里下载alignbench适配opencompass的数据集
```
@LOAD_DATASET.register_module()
class SubjectiveCmpDataset(BaseDataset):

    def load(self, path: str, name: str, *args, **kwargs):
        path = get_data_path(path, local_mode=True)
        filename = osp.join(path, f'{name}.json')
        dataset = DatasetDict()
        raw_data = []
        with open(filename, 'r', encoding='utf-8') as f:
            json_data = json.load(f)
            for problem in json_data:
                question = problem['question']
                capability = problem['capability']
                others = problem['others']
                raw_data.append({
                    'question': question,
                    'capability': capability,
                    'others': others,
                    'judge': {
                        'capability': capability,
                        'question': question
                    }
                })
        dataset = Dataset.from_list(raw_data)
        return dataset
@LOAD_DATASET.register_module()
class AlignmentBenchDataset(SubjectiveCmpDataset):

    def load(self,
             path: str,
             name: str,
             alignment_bench_config_path: Optional[str] = '',
             alignment_bench_config_name: Optional[str] = '',
             *args,
             **kwargs):
        if alignment_bench_config_path != '':
            alignmentbench_config = Config(alignment_bench_config_path,
                                           alignment_bench_config_name)
        else:
            alignmentbench_config = None
        dataset = list(super().load(path, name))
        alignbench_dataset = []
        for data in dataset:
            if alignmentbench_config:
                dimensions, prefix = prompt_construct(data,
                                                      alignmentbench_config)
                data['critiquellm_prefix'] = prefix
            data['judge']['others'] = data['others']
            data['ref'] = data['others']['reference']
            alignbench_dataset.append(data)
        dataset = Dataset.from_list(alignbench_dataset)
        return dataset
```

### Reproduces the problem - command or script

...

### Reproduces the problem - error message

...

### Other information

_No response_

一般来说，在你使用opencompass的时候会触发opencompass格式的数据集自动下载的，如果没有自动下载，可以在这里下载：https://github.com/open-compass/opencompass/blob/c3779ebfc14d872ca726c81e26fc7d2a813731d6/opencompass/utils/datasets_info.py#L613， 并放置到data/subjective下

> 一般来说，在你使用opencompass的时候会触发opencompass格式的数据集自动下载的，如果没有自动下载，可以在这里下载：[https://github.com/open-compass/opencompass/blob/c3779ebfc14d872ca726c81e26fc7d2a813731d6/opencompass/utils/datasets_info.py#L613，](https://github.com/open-compass/opencompass/blob/c3779ebfc14d872ca726c81e26fc7d2a813731d6/opencompass/utils/datasets_info.py#L613%EF%BC%8C) 并放置到data/subjective下

好的，感谢！