Spaces:

open-llm-leaderboard

/

open_llm_leaderboard

like 11.7k

Running on CPU Upgrade

And another one

https://huggingface.co/datasets/open-llm-leaderboard/requests/blob/main/TitleOS/EinsteinBagel-8B_eval_request_False_bfloat16_Original.json

@clefourrier Why is this leaderboard so unreliable? Atleast 90% of my requested evaluations fail.

Hi @Dampfinchen ,
Just checked the logs and there was a connection error on both your models download. I passed the models back to pending (feel free to reopen if they fail again), and will investigate why we are experiencing more network error these days.