Submitting is dead?

#639
by Stopwolf - opened

I feel like models submitted for evaluation aren't coming through. For at least two days number of submitted models seems to be 5489, while currently evaluated models and models in queue remain same, or keep growing.

the HF cluster is sometimes busy with doing things other than running the Open LLM Leaderboard. It should resolve itself after it has finished with whatever it is doing right now.

Open LLM Leaderboard org

Thanks for answering @nlpguy , this is entirely correct. Closing this issue :)

clefourrier changed discussion status to closed

Sign up or log in to comment