Repository: open-compass/opencompass
Issue: 怎么评测自己训练的模型呢，我看eval_demo.py都是hugging face的模型
Root cause: Documentation Deficiency

### Prerequisite

- [X] I have searched [Issues](https://github.com/InternLM/opencompass/issues/) and [Discussions](https://github.com/InternLM/opencompass/discussions) but cannot get the expected help.
- [X] The bug has not been fixed in the [latest version](https://github.com/InternLM/opencompass).

### Type

I'm evaluating with the officially supported tasks/models/datasets.

### Environment

1

### Reproduces the problem - code/configuration sample

1

### Reproduces the problem - command or script

1

### Reproduces the problem - error message

1

### Other information

1

Please follow this tutorial for evaluating your own models.
https://opencompass.readthedocs.io/en/latest/advanced_guides/new_model.html

- We also provide some exampls:
  - https://github.com/InternLM/opencompass/blob/main/opencompass/models/llama2.py
  - https://github.com/InternLM/opencompass/blob/main/opencompass/models/glm.py
- Config:
  - https://github.com/InternLM/opencompass/blob/main/configs/models/llama2_7b_chat.py

改完配置后，我怎么运行呢

Traceback (most recent call last):
  7   File "/home/hadoop-hmart-waimai-rank/.conda/envs/opencompass/bin/torchrun", line 33, in <module>
  8     sys.exit(load_entry_point('torch==2.0.1', 'console_scripts', 'torchrun')())
  9   File "/home/hadoop-hmart-waimai-rank/.conda/envs/opencompass/lib/python3.10/site-packages/torch/distributed/elastic/multiprocessing/errors/__init__.py", line 346, in wrapper
 10     return f(*args, **kwargs)
 11   File "/home/hadoop-hmart-waimai-rank/.conda/envs/opencompass/lib/python3.10/site-packages/torch/distributed/run.py", line 794, in main
 12     run(args)
 13   File "/home/hadoop-hmart-waimai-rank/.conda/envs/opencompass/lib/python3.10/site-packages/torch/distributed/run.py", line 785, in run
 14     elastic_launch(
 15   File "/home/hadoop-hmart-waimai-rank/.conda/envs/opencompass/lib/python3.10/site-packages/torch/distributed/launcher/api.py", line 134, in __call__
 16     return launch_agent(self._config, self._entrypoint, list(args))
 17   File "/home/hadoop-hmart-waimai-rank/.conda/envs/opencompass/lib/python3.10/site-packages/torch/distributed/launcher/api.py", line 250, in launch_agent
 18     raise ChildFailedError(
 19 torch.distributed.elastic.multiprocessing.errors.ChildFailedError:

他会报这个错


You may share more details about your models' implementation, preferably following the [issue template](https://github.com/InternLM/opencompass/issues/new?assignees=&labels=bug&projects=&template=1_bug-report.yml&title=%5BBug%5D+). We need more context to understand your situation. 

我在一块A100上，加载本地的llama2模型在mmlu数据集上进行评测，但是一直报torch.distributed.elastic.multiprocessing.errors.ChildFailedError:的错




Here is an example config for the original llama (not the HF version): https://github.com/InternLM/opencompass/blob/main/configs/models/llama2_7b_chat.py

You may test out the configuration before you try your own one.

> 我在一块A100上，加载本地的llama2模型在mmlu数据集上进行评测，但是一直报torch.distributed.elastic.multiprocessing.errors.ChildFailedError:的错

检查一下你的RAM内存够不够 @Sweetclover 

Feel free to re-open if needed.

> Please follow this tutorial for evaluating your own models. https://opencompass.readthedocs.io/en/latest/advanced_guides/new_model.html
> 
> * We also provide some exampls:
>   
>   * https://github.com/InternLM/opencompass/blob/main/opencompass/models/llama2.py
>   * https://github.com/InternLM/opencompass/blob/main/opencompass/models/glm.py
> * Config:
>   
>   * https://github.com/InternLM/opencompass/blob/main/configs/models/llama2_7b_chat.py

glm.py 这个文件 支持的好像也是本地模型，opencompass 是否支持glm的API调用呢？需要自己适配吗？