Spaces:

open-llm-leaderboard

/

open_llm_leaderboard

like 10.2k

Running on CPU Upgrade

Hi ! Thanks for the notice, this is because when a model is not using safetensor, we parse the model name to know the size and it fails here. We will fix this asap.

A user kindly created a PR for this, it should be fixed when the leaderboard finished building but we'll need to edit request files retroactively

Hi @felixz ,
The regex has been pushed.
Would you be so kind as to open PR on the request files where the saved model size is incorrect, or just point us to the correct list so we can edit it manually? It would be a time saver

Closing for inactivity, feel free to reopen if needed