Spaces:

open-llm-leaderboard

/

open_llm_leaderboard

like 10.3k

Running on CPU Upgrade

When I try to submit falcon based model via clicking Submit Eval button, it says

Model "~" needs to be launched with `trust_remote_code=True`.
For safety reason, we do not allow these models to be automatically submitted to the leaderboard.

It seems this problem has been addressed here and here.

I understand the safety issues related to trust_remote_code. But since falcon is on the top of the leaderboard, it would be great if it becomes possible to submit falcon based models as soon as possible.