Spaces:

open-llm-leaderboard

/

open_llm_leaderboard

like 10.9k

Running on CPU Upgrade

I didn't think this was possible (trust remote code) according to the leaderboard's FAQ.

Edit: That model does look interesting though.

That's why I request here. HF staff can do it manually.

As cohere didn't give us their official benchmark scores, it is good to see it on the community leaderboard.

Hi!
We have discussed this with Cohere prior to their release, and since the model is not a base pretrained model, we will not evaluate it manually.
However, since the code is in the process of being integrated, we will update transformers as soon as it's done to allow its submission on the leaderboard.

@JosephusCheung Just noticed c4ai-command-r-v01 has been evaluated.

Edit: No longer marked private or delete.

I'll investigate why it's under private or deleted

@clefourrier Sorry, It was private or deleted. Just checked, and now it's not.

Oh cool! One less todo for tomorrow morning! :D