Spaces:
Runtime error
Runtime error
| title: Bittensor Lmeh Evaluations | |
| emoji: 🏆 | |
| colorFrom: green | |
| colorTo: indigo | |
| sdk: gradio | |
| sdk_version: 3.33.1 | |
| app_file: app.py | |
| pinned: false | |
| Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference | |
| # HF LLM Leaderboard Evluation Scripts for Bittensor Validatos | |
| ### Install LM-Eval | |
| ``` | |
| git clone https://github.com/EleutherAI/lm-evaluation-harness | |
| cd lm-evaluation-harness | |
| pip install -e . | |
| ``` | |
| ### Running Evaluations on Bittensor's Validator | |
| ``` | |
| python3 eval_bittensor.py --validator opentensor_foundation | |
| ``` | |
| ### Running Evaluations on Bittensor's Validator | |
| ``` | |
| export BITAPAI_KEY = XXXX | |
| python3 eval_bittensor.py --validator tasostats | |
| ``` |