Zephyr-7B-alpha on LLM leaderboard, why not Zephyr-7b-beta?
I'd love to get the LLM leaderboard's opinion on how Zephyr-7B-beta compares to other Mistral finetunes. Could we get it submitted for evaluation?
Thanks for the reminder @YokaiKoibito ! I think we do have the evals, but forgot to make them public. Maybe @clefourrier or @SaylorTwift can add them now?
@lewtun Cannot find these evals in the private datasets, would you be OK resubmitting?
@lewtun I'm still keen to see this ASAP: I'd love to move our use case up from Alpha to Beta.
@YokaiKoibito feel free to submit it if you'd like :)
It's not my model, and anyway, it looks like it's already in the Pending Evaluation Queue (twice).
You can submit models that are not yours as long as they are public :)
If it's pending, it will get evaluated in the next weeks, since we are catching up on the queue now! And models appearing two times have usually been submitted at different precisions (it's explained in our FAQ if you want more details)
Closing then, since it's going to be evaluated!