zhiminy/EvalEng huggingface dataset:
Repository: open-compass/opencompass
Issue: [Feature] 8卡A100*80G评测Qwen1.5-72B推荐的参数设置是怎么样的呢
Root cause: Documentation Deficiency

### Describe the feature

现在采用的参数如下：
`models = [
    dict(
        type=HuggingFaceCausalLM,
        abbr='qwen1.5-72b-chat-hf',
        path="Qwen1.5-72B-Chat",
        model_kwargs=dict(
            device_map='auto',
            trust_remote_code=True
        ),
        tokenizer_kwargs=dict(
            padding_side='left',
            truncation_side='left',
            trust_remote_code=True,
            use_fast=False,
        ),
        meta_template=_meta_template,
        max_out_len=100,
        max_seq_len=2048,
        batch_size=8,
        run_cfg=dict(num_gpus=4, num_procs=1),
        end_str='
',
        batch_padding=True,
    )
]`

感觉评测很慢，20多个小时都没出结果

### Will you implement it?

- [ ] I would like to implement this feature and create a PR!
Repository: open-compass/opencompass
Issue: 测试本地hf模型，怎么确定合适的max-out-len，比如storycloze[Feature] 
Root cause: Documentation Deficiency

### Describe the feature

加载本地的hf模型之后，想测试storycloze_gen数据，但不知道max-out-len该设置多少，其他数据，比如mmlu也是不确定该参数应该多少，这个应该怎么确定呢，可以给每个任务一个默认的预测长度吗，合理的默认长度
```
--datasets storycloze_gen  --max-out-len ???
--datasets mmlu_gen  --max-out-len ???
```

### Will you implement it?

- [ ] I would like to implement this feature and create a PR!

It's hard to set a prefect 'max-out-len' for a task, for different models have different preference. When model A prefer to give the answer directly, models B may give final answer after long chain of thoughts.

A better way to detect the setting of 'max-out-len' is to run some examples on the tested model and see the average response length, as a specific model always have similar response lengths for the same task.

Still, there are some practiced conclusions:
- For multiple choice question tasks like StoryCloze or MMLU, a length of 100 will satisfy the vast majority of cases.
- For matematical problems like MATH and GSM8K, a length of 1024 may be better due to the model need a long reasoning process to get final answers.
- For some subjective benchmarks like MTbench or Alpaca_eval, it also needs to be set to a very long length, as some questions will require the model to design a very detailed program or write a well-developed code script.
Repository: open-compass/opencompass
Issue: CMB + Qwen1.5-72B-Chat got empty answers
Root cause: Configuration Error

### Prerequisite

- [X] I have searched [Issues](https://github.com/open-compass/opencompass/issues/) and [Discussions](https://github.com/open-compass/opencompass/discussions) but cannot get the expected help.
- [X] The bug has not been fixed in the [latest version](https://github.com/open-compass/opencompass).

### Type

I'm evaluating with the officially supported tasks/models/datasets.

### Environment

python -c "import opencompass.utils;import pprint;pprint.pprint(dict(opencompass.utils.collect_env()))"

### Reproduces the problem - code/configuration sample
CUDA_VISIBLE_DEVICES="0,1,2,3" python run.py \
  --datasets cmb_gen_dfb5c4 \
  --hf-path "/Qwen1.5-72B-Chat/" \
  --model-kwargs device_map='auto' trust_remote_code=True \
  --tokenizer-kwargs padding_side='left' truncation='left' trust_remote_code=True \
  --max-out-len 100 \
  --max-seq-len 2048 \
  --batch-size1 \
  --num-gpus 4 


### Reproduces the problem - command or script
CUDA_VISIBLE_DEVICES="0,1,2,3" python run.py \
  --datasets cmb_gen_dfb5c4 \
  --hf-path "/Qwen1.5-72B-Chat/" \
  --model-kwargs device_map='auto' trust_remote_code=True \
  --tokenizer-kwargs padding_side='left' truncation='left' trust_remote_code=True \
  --max-out-len 100 \
  --max-seq-len 2048 \
  --batch-size1 \
  --num-gpus 4 

### Reproduces the problem - error message
CMB + qwen1.5-72b-chat: test acc=0.26%, almost all the predictions in cmb_test_k.json are "" (no answers). 
examples:
    "21": {
        "origin_prompt": "以下是中国医师考试中规培结业考试的一道多项选择题，不需要做任何分析和解释，直接输出答案选项。\n每一精神症状均有明确定义，并具有以下特点\nA. 症状的出现不受病人意识控制\nB. 症状出现可受病人意识控制\nC. 症状可以通过转移的方法使其消失\nD. 症状内容与周围环境不相称\nE. 症状给病人带来不同程度的功能损害 \n 答案: ",
        "prediction": "",
        "gold": "NULL"
    },
    "22": {
        "origin_prompt": "以下是中国医师考试中规培结业考试的一道单项选择题，不需要做任何分析和解释，直接输出答案选项。\n关于慢性粒细胞白血病，错误的是\nA. 造血干细胞恶性克隆性疾病\nB. 自然病程仅数月\nC. 分为慢性期、加速期和急变期\nD. 最显著的体征是脾大\nE. 血象白细胞持续增高 \n 答案: ",
        "prediction": "",
        "gold": "NULL"
    },
    "23": {
        "origin_prompt": "以下是中国医师考试中规培结业考试的一道单项选择题，不需要做任何分析和解释，直接输出答案选项。\n确定颌位关系包括\nA. 定位平面记录\nB. 下颌后退记录\nC. 面下1/3高度记录\nD. 垂直距离和下颌前伸（牙合）记录\nE. 垂直距离和正中关系记录 \n 答案: ",
        "prediction": "",
        "gold": "NULL"
    },

While CMB + qwen1.5-32b-chat is normal with an acc around 52%
### Other information

_No response_

You can try to set ```do_sample = True``` in model's generation_kwargs and see whether have differences.
Repository: open-compass/opencompass
Issue: [Feature] Typos in the official document

### Describe the feature

Hi,
I found some typos in the efficient evaluation of the official document.

In the following code snippet:
https://github.com/open-compass/opencompass/blob/6c711cb262344b8819894a61f2791d5674e5cf73/docs/en/user_guides/evaluation.md?plain=1#L88-L100
line 97 `task=dict(type=OpenICLEvalTask)` should be `task=dict(type=OpenICLInferTask)`.

And the following line 118 has the same typo: 
https://github.com/open-compass/opencompass/blob/6c711cb262344b8819894a61f2791d5674e5cf73/docs/en/user_guides/evaluation.md?plain=1#L110-L123

### Will you implement it?

- [X] I would like to implement this feature and create a PR!

Thanks for pointing this typo, we will refine it soon.
Repository: open-compass/opencompass
Issue: 可以创建一个微信群吗？

### 描述该功能

题目

### 是否希望自己实现该功能？

- [ ] 我希望自己来实现这一功能，并向 OpenCompass 贡献代码！

wechat: https://cdn.vansin.top/opencompass/opencompass.jpg
discord: https://discord.com/invite/KKwfEbFj7U

Feel free to re-open if needed.
Repository: open-compass/opencompass
Issue: [Feature] AGIEval数据集是否可以支持few-shot评测设置？
Root cause: Unimplemented Feature Gap

### 描述该功能

opencompass/opencompass/datasets/agieval/agieval.py 文件显示，目前AGIEval评测仅支持zero-shot设置：

```
def load(path: str, name: str, setting_name: str):
      from .dataset_loader import load_dataset, load_dataset_as_result_schema

      assert setting_name in 'zero-shot', 'only support zero-shot setting'
      dataset_wo_label = load_dataset(name, setting_name, path)
      dataset_with_label = load_dataset_as_result_schema(name, path)
      dataset = []
      for d1, d2 in zip(dataset_wo_label, dataset_with_label):
          dataset.append({
              'id': d2.index,
              'problem_input': d1['context'],
              'label': d2.label,
          })
      dataset = Dataset.from_list(dataset)
      return dataset
```

原生AGIEval支持few-shot设置，是否可以追加few-shot评测设置？

### 是否希望自己实现该功能？

- [ ] 我希望自己来实现这一功能，并向 OpenCompass 贡献代码！
Repository: open-compass/opencompass
Issue: the prompt for triviaqa dataset
Root cause: Documentation Deficiency

### Describe the feature

triviaqa数据集的每条的question本身就有"?"，triviaqa_gen_2121ce.py的prompt中在最后又加了一个"?"。请问该问号是不是可以去掉，还是加上这个问号性能会更好更稳定吗？

### Will you implement it?

- [X] I would like to implement this feature and create a PR!
Repository: open-compass/opencompass
Issue: [Feature] MMLU-PRO
Root cause: Unimplemented Feature Gap

### Describe the feature

Huggingface : https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro?row=0

<img width="857" alt="image" src="https://github.com/open-compass/opencompass/assets/18586273/b4f9f950-c361-4d22-9d50-0bea3d386d15">


### Will you implement it?

- [ ] I would like to implement this feature and create a PR!

Welcome to contribute this dataset into OpenCompass.
Repository: open-compass/opencompass
Issue: [Bug] RACE数据集在hf-llama-7b上的评测结果异常
Root cause: Algorithmic Error

### 先决条件

- [X] 我已经搜索过 [问题](https://github.com/open-compass/opencompass/issues/) 和 [讨论](https://github.com/open-compass/opencompass/discussions) 但未得到预期的帮助。
- [X] 错误在 [最新版本](https://github.com/open-compass/opencompass) 中尚未被修复。

### 问题类型

我正在使用官方支持的任务/模型/数据集进行评估。

### 环境

参考opencompass docs配置

### 重现问题 - 代码/配置示例

同官方

### 重现问题 - 命令或脚本

python run.py \
    --models hf_llama_7b \
    --datasets race_ppl_5831a0 \
    --work-dir ./outputs/debug/lm/race_ppl_5831a0 \
    --num-gpus 1 \
    --max-partition-size 1000 \
    --max-num-workers 8 

### 重现问题 - 错误信息

无

### 其他信息

在PIQA、SIQA、WinoGrande上的结果与Llama原论文的指标均能对齐。
在race_ppl_5831a0上的RACE-middle和RACE-high分别为36.70和30.59，原文为61.1和46.9。
Repository: open-compass/opencompass
Issue: 自定义的模型API都要配置步骤有哪些，除了写config文件外
Root cause: Documentation Deficiency

### Describe the feature

自定义的模型API都要配置步骤有哪些，除了写config文件外

### Will you implement it?

- [ ] I would like to implement this feature and create a PR!

遇到同样的问题，正在自己看源码。

已经解决，需要修改 model/openai_api相关内容

@ItTestKing 能说得具体点吗

I have modified the get_token_len method in the file opencompass/models/openai_api.py, as follows:

    def get_token_len(self, prompt: str) -> int:
        """Get lengths of the tokenized string. Only English and Chinese
        characters are counted for now. Users are encouraged to override this
        method if more accurate length is needed.

        Args:
            prompt (str): Input string.

        Returns:
            int: Length of the input tokens
        """
        #enc = self.tiktoken.encoding_for_model(self.path
        #                                       or self.tokenizer_path)
        try:
            enc = self.tiktoken.encoding_for_model(self.path or self.tokenizer_path)
        except KeyError:
            #print("Warning: model not found. Using cl100k_base encoding.")
            enc = self.tiktoken.get_encoding("cl100k_base")
        return len(enc.encode(prompt))
Repository: open-compass/opencompass
Issue: [Feature] Loading the same model multiple times in opencompass for evaluation on MMLU dataset
Root cause: Documentation Deficiency

### Describe the feature

I am currently using LLaMa to evaluate PPL's ACC on MMLU dataset and I have a question about opencompass toolkit. When I use opencompass to divide the evaluation task into 40 sub-tasks, does this mean that the toolkit loads the same model 40 times for evaluation? From my observation, the time it takes to load the model is equivalent to the inference time. Therefore, I am concerned that the evaluation may take a long time due to the repeated loading of the model.


Additionally, I am wondering if it is possible to configure the opencompass config to support batch inference? This could potentially improve the efficiency of the evaluation process.


I would greatly appreciate it if you could provide detailed guidance on these issues.

### Will you implement it?

- [ ] I would like to implement this feature and create a PR!

It's a good catch. OpenCompass's task division system is designed for cluster management system like Slurm, which would dispatch tasks to different nodes for parallel evaluation. However, it can hamper the evaluation process if it is just running on a single node, since each task requires a complete reloading of the weights. The simplest way is to increase the task size to reduce the number of tasks; or you may divide deeper into the docs about Partitioner and switch the strategy to NaivePartitioner (https://opencompass.readthedocs.io/en/latest/user_guides/evaluation.html#task-partition-partitioner).

Batch inference is natively supported, you can specify batch_size in model's config, as already mentioned in Getting Started.
Repository: open-compass/opencompass
Issue: 泛化性更好的评测方式
Root cause: Unimplemented Feature Gap

### 描述该功能

针对现有公开评测集llm刷榜现象严重，不能反映模型真实效果，咱们这边有更鲁棒、泛化性更好的评测方式吗

### 是否希望自己实现该功能？

- [ ] 我希望自己来实现这一功能，并向 OpenCompass 贡献代码！

 We provide OpenCompass 2.0 leaderboard for LLM, which consists of the non-public data.

Feel free to re-open if needed.
Repository: open-compass/opencompass
Issue: [Bug] CLUEWSC的测试结果全是 50%
Root cause: Validation Gap

### Prerequisite

- [X] I have searched [Issues](https://github.com/open-compass/opencompass/issues/) and [Discussions](https://github.com/open-compass/opencompass/discussions) but cannot get the expected help.
- [X] The bug has not been fixed in the [latest version](https://github.com/open-compass/opencompass).

### Type

I'm evaluating with the officially supported tasks/models/datasets.

### Environment

使用的版本是 0.2.3

### Reproduces the problem - code/configuration sample

    python3 ${OPENCOMPASS_PATH}/run.py --work-dir ${OPENCOMPASS_PATH} \
        --datasets FewCLUE_cluewsc_ppl \
        --hf-path ${model_path} \
        --config-dir ${OPENCOMPASS_PATH}/configs \
        --model-kwargs device_map='auto' trust_remote_code=True \
        --tokenizer-kwargs padding_side='right' truncation='left' trust_remote_code=True add_special_tokens=False \
        --max-seq-len 4096 \
        --max-out-len 100 \
        --batch-size 1  \
        --reuse results/${model_name} \
        --num-gpus 8

### Reproduces the problem - command or script

    python3 ${OPENCOMPASS_PATH}/run.py --work-dir ${OPENCOMPASS_PATH} \
        --datasets FewCLUE_cluewsc_ppl \
        --hf-path ${model_path} \
        --config-dir ${OPENCOMPASS_PATH}/configs \
        --model-kwargs device_map='auto' trust_remote_code=True \
        --tokenizer-kwargs padding_side='right' truncation='left' trust_remote_code=True add_special_tokens=False \
        --max-seq-len 4096 \
        --max-out-len 100 \
        --batch-size 1  \
        --reuse results/${model_name} \
        --num-gpus 8

### Reproduces the problem - error message

我测试了 Qwen1.5-1.8B, Gemma-2b, rwkv-5-world-1b5 和 MiniCPM-2B-sft-fp32。结果是：
50.31/50.31/50.31/52.20
这个结果和瞎猜没区别。而且这个任务不能选择 few-shot，我理解应该任意任务都可以设置 few-shot 而不是像现在这种每个任务是写死的？

### Other information

_No response_
Repository: open-compass/opencompass
Issue: [Feature] Leval数据集少了两个config：codeU和sci_fi
Root cause: Unimplemented Feature Gap

### 描述该功能

Leval数据集希望新增两个config：codeU和sci_fi

### 是否希望自己实现该功能？

- [ ] 我希望自己来实现这一功能，并向 OpenCompass 贡献代码！
Repository: open-compass/opencompass
Issue: [Feature] Falmes dataset evaluation seems to be missing configs and json file
Root cause: Unimplemented Feature Gap

### Describe the feature

I got the json file from Falmes official repo, but the following error occured: FileNotFoundError: [Errno 2] No such file or directory: './data/flames/data_protection_config.txt'
After checking the code from "opencompass/datasets/flames.py", I found at the 43 lines: "config = Config(path, f'{name}_config.txt')" was used, but the official repo did not provide any config. 

### Will you implement it?

- [ ] I would like to implement this feature and create a PR!

It would be best if the missing files could be added.

Hi, the entire dataset should be in here:
https://huggingface.co/datasets/opencompass/flames
I think flames official will update later

Great! Problem solved. Thank you.
Repository: open-compass/opencompass
Issue: [Feature] 支持openai/GPT4-o的评测seting
Root cause: Documentation Deficiency

### 描述该功能

链接： https://github.com/openai/simple-evals

<img width="1005" alt="image" src="https://github.com/open-compass/opencompass/assets/18586273/abc5edf2-763c-4bf9-a949-7dbc450a6fff">

GPT4-o的这套评测seting是非常具备参考价值的。预计被大家关注并使用。



### 是否希望自己实现该功能？

- [ ] 我希望自己来实现这一功能，并向 OpenCompass 贡献代码！

We have already supported these settings. You can find more details in the configs. Documentation will be updated soon
Repository: open-compass/opencompass
Issue: GenInferencer PPLInferencer  不能集成到一起吗[Feature] 
Root cause: Unimplemented Feature Gap

### Describe the feature

GenInferencer PPLInferencer  本身都是基于模型的推理结果进行计算，现在只能二选一，如果想看两次结果就需要跑模型推理两边，有点浪费计算资源了，能改成同时开启吗

### Will you implement it?

- [ ] I would like to implement this feature and create a PR!

The prompts of these two modes are different.

Feel free to re-open if needed.
Repository: open-compass/opencompass
Issue: [Feature] 如何在needlebench 中使用api model？
Root cause: Documentation Deficiency

### Describe the feature

 如何再needlebench 中使用api model，api example中的用法用不了 

### Will you implement it?

- [ ] I would like to implement this feature and create a PR!

您好 @1518630367 ，

感谢您的提问。关于在 needlebench 中使用 API 模型的问题，需要说明，模型的配置和数据集的配置是相互独立的。所以不论使用哪个数据集（例如 needlebench），都可以引入 API 模型进行评测。例如`configs/api_examples/eval_api_zhipu_v2.py`是针对智谱API的测试config，您可以作为参考。

如果您在使用某些 API 示例时遇到问题，麻烦您能否提供更详细的问题描述或错误信息，这样我们才能更有针对性地帮助您解决问题。

谢谢！

具体怎么用，能给个例子么
Repository: open-compass/opencompass
Issue: [Feature] config的bug，提示下载configs，然后下载了又出现以下bug
Root cause: Configuration Error

### Describe the feature

(opencompass) -bash-4.2$ python run.py ./configs/api_examples/eval_api_zhipu_v2.py  --debug
        Traceback (most recent call last):
  File "/home/wumao/opencompass-main/run.py", line 4, in <module>
    main()
  File "/home/wumao/opencompass-main/opencompass/cli/main.py", line 225, in main
    cfg = get_config_from_arg(args)
  File "/home/wumao/opencompass-main/opencompass/utils/run.py", line 75, in get_config_from_arg
    config = Config.fromfile(args.config, format_python_code=False)
  File "/home/wumao/miniconda3/envs/opencompass/lib/python3.10/site-packages/mmengine/config/config.py", line 494, in fromfile
    raise e
  File "/home/wumao/miniconda3/envs/opencompass/lib/python3.10/site-packages/mmengine/config/config.py", line 492, in fromfile
    cfg_dict, imported_names = Config._parse_lazy_import(filename)
  File "/home/wumao/miniconda3/envs/opencompass/lib/python3.10/site-packages/mmengine/config/config.py", line 1074, in _parse_lazy_import
    raise ConfigParsingError(
mmengine.config.utils.ConfigParsingError: /home/wumao/miniconda3/envs/opencompass/lib/python3.10/site-packages/configs/summarizers/medium.py not found! It means that incorrect module is defined in `with read_base(): = from configs.summarizers.medium import ...`, please make sure the base config module is valid and is consistent with the prior import logic
(opencompass) -bash-4.2$ python run.py ./configs/api_examples/eval_api_zhipu_v2.py  --debug
Traceback (most recent call last):
  File "/home/wumao/opencompass-main/run.py", line 4, in <module>
    main()
  File "/home/wumao/opencompass-main/opencompass/cli/main.py", line 225, in main
    cfg = get_config_from_arg(args)
  File "/home/wumao/opencompass-main/opencompass/utils/run.py", line 76, in get_config_from_arg
    config = Config.fromfile(args.config, format_python_code=False)
  File "/home/wumao/miniconda3/envs/opencompass/lib/python3.10/site-packages/mmengine/config/config.py", line 494, in fromfile
    raise e
  File "/home/wumao/miniconda3/envs/opencompass/lib/python3.10/site-packages/mmengine/config/config.py", line 492, in fromfile
    cfg_dict, imported_names = Config._parse_lazy_import(filename)
  File "/home/wumao/miniconda3/envs/opencompass/lib/python3.10/site-packages/mmengine/config/config.py", line 1074, in _parse_lazy_import
    raise ConfigParsingError(
mmengine.config.utils.ConfigParsingError: /home/wumao/miniconda3/envs/opencompass/lib/python3.10/site-packages/configs/summarizers/medium.py not found! It means that incorrect module is defined in `with read_base(): = from configs.summarizers.medium import ...`, please make sure the base config module is valid and is consistent with the prior import logic

### Will you implement it?

- [ ] I would like to implement this feature and create a PR!

Same
Repository: open-compass/opencompass
Issue: [Bug]  unrecognized arguments: --no-batch-padding
Root cause: Documentation Deficiency

### Prerequisite

- [X] I have searched [Issues](https://github.com/open-compass/opencompass/issues/) and [Discussions](https://github.com/open-compass/opencompass/discussions) but cannot get the expected help.
- [X] The bug has not been fixed in the [latest version](https://github.com/open-compass/opencompass).

### Type

I'm evaluating with the officially supported tasks/models/datasets.

### Reproduces the problem - error message

```
 unrecognized arguments: --no-batch-padding
```

### Other information

`--no-batch-padding` has been removed in https://github.com/open-compass/opencompass/commit/7505b3cadf51ab7c8596c79316c008b7b748f5b4, but still exists in many documents

 Thanks for the report. We will fix the doc soon.
Repository: open-compass/opencompass
Issue: opencompass榜单更新情况

### 描述该功能

opencompass榜单中对于公开数据集的评测还会更新吗，我看2024年后公开模型在公开数据集的评测都没有更新了

### 是否希望自己实现该功能？

- [ ] 我希望自己来实现这一功能，并向 OpenCompass 贡献代码！

Thanks for the report. We plan to release the reference performance of recent LLM on open-source benchmarks this week.

The latest version has include the detailed performance in configs(e.g. https://github.com/open-compass/OpenCompass/blob/main/configs/models/hf_internlm/README.md)
We will update the homepage soon. Feel free to re-open if needed.
Repository: open-compass/opencompass
Issue: No module named 'opencompass'
Root cause: Environment Incompatibility

### 先决条件

- [X] 我已经搜索过 [问题](https://github.com/open-compass/opencompass/issues/) 和 [讨论](https://github.com/open-compass/opencompass/discussions) 但未得到预期的帮助。
- [X] 错误在 [最新版本](https://github.com/open-compass/opencompass) 中尚未被修复。

### 问题类型

我正在使用官方支持的任务/模型/数据集进行评估。

### 环境

pip install -e .
python tools/list_configs.py llama mmlu
![image](https://github.com/open-compass/opencompass/assets/48884346/e84e31f3-bd9b-4352-87cf-ddf6b1dc8f11)



### 重现问题 - 代码/配置示例

python 3.8.18
A100 40G


### 重现问题 - 命令或脚本

unzip data
![image](https://github.com/open-compass/opencompass/assets/48884346/fc359af3-ac21-4fe1-bd31-e26956173a11)
pip install -e .
python tools/list_configs.py llama mmlu

### 重现问题 - 错误信息

No module named 'opencompass'
![image](https://github.com/open-compass/opencompass/assets/48884346/d8b70f45-e28b-4cb8-a00a-044865ed7f0c)


### 其他信息

i see it generate a new fold false  after execute 'pip install -e .', 
![image](https://github.com/open-compass/opencompass/assets/48884346/fc2cbcc1-2b53-4652-a402-3f8df5399a15)
but i do not understand

plz show the result of these commands

```bash
which python
which pip
```

@Leymore  python 3.8.18  pip 24.0

are `python` and `pip` under the same env? this can be shown via the `which` command.

value of env `PATH` should also be checked.

Please make sure that you have successfully installed the OpenCompass in your current env.

sure,while i execute 'pip install .' i can find OpenCompass  in pip list,but when i  execute 'pip install -e  .' i can not find OpenCompass  in pip list, can i use 'pip install .' ？

> are `python` and `pip` under the same env? this can be shown via the `which` command.
> 
> value of env `PATH` should also be checked.

i execute pip  --version  and   python --version to check the version,i  am sure  that  they under the same env


> Please make sure that you have successfully installed the OpenCompass in your current env.

@tonysy  sorry，but how can i confirm i have successfully installed the OpenCompass 

@hellostronger Install from source on main branch and try again

Feel free to re-open if needed.