Spaces:

open-llm-leaderboard

/

open_llm_leaderboard

like 10.9k

Running on CPU Upgrade

Thanks for your report, I'll investigate!

It happened to this one as well. I initially thought it was because ti scored much higher on the GSM8K so it was flagged.

I then set the model to private so that nobody would use it for further fine tuning. It now seems like it might be related to a wider issue.

Is there any new information on this? 🙏

Hi!

Quite sure our dynamic info updater script (checking if models are still online for ex) is making the space OOM and restart instead of running every day (this info should be updated daily).
I'm working on running it elsewhere! :)

Thanks @clefourrier !

Hi! These models should now all appear correctly (as long as you untoggle the checkbox to hide models containing merges/moerges)!
Feel free to reopen if needed :)