the model I submitted keeps failing

#205
by yeontaek - opened

I'm curious why the model I submitted is showing as 'fail'.

It's not much different from the models I previously submitted.

https://huggingface.co/datasets/open-llm-leaderboard/requests/commit/5e5c8cc731da8732058d2887143f7dc88a28984a

@clefourrier

Fail occurs in all models that I submit. I want to know if this is because I am submitting incorrect models, or if there is a problem with the evaluation hardware.

https://huggingface.co/datasets/open-llm-leaderboard/requests/commit/0a684c947d603e9dc7e42fa4115d2ddcf0e7f0dc

Open LLM Leaderboard org

Hi!
We had a connectivity problem over the weekend, I uploaded your results!
Thank you for your report and your patience :)

clefourrier changed discussion status to closed

Sign up or log in to comment