| evaluate my_api model: | |
| 1、prepare the environment | |
| cd opencompass | |
| conda create --name opencompass python=3.10 pytorch torchvision pytorch-cuda -c nvidia -c pytorch -y | |
| conda activate opencompass | |
| pip install -e . | |
| 2、download the evaluation set | |
| # Download dataset to data/ folder | |
| wget https://github.com/open-compass/opencompass/releases/download/0.2.2.rc1/OpenCompassData-core-20240207.zip | |
| unzip OpenCompassData-core-20240207.zip | |
| 3、testing xxx dataset | |
| python run.py --models my_api --datasets xxx_gen |