Spaces:
Running
on
CPU Upgrade
Is it possible to run this locally? Docker image is crashing
As the run queue for the leaderboard is so long , will it be possible to run this locally
tried using docker not working
then tried to clone the repo and manually launch app.py
Getting this error
Traceback (most recent call last):
File "/home/qblocks/open_llm_leaderboard/app.py", line 141, in
) = get_evaluation_queue_df()
File "/home/qblocks/open_llm_leaderboard/app.py", line 93, in get_evaluation_queue_df
for entry in os.listdir(EVAL_REQUESTS_PATH)
FileNotFoundError: [Errno 2] No such file or directory: 'auto_evals/eval_requests'
Any inputs on this would be highly appreciated
Hi! It's not at the moment possible to run this locally, as the dataset containing the model scores is not yet public - however, we are doing our best to make it available soon, and when that's done you'll be able to run it locally!