Is the eval server down?

#589
by appoose - opened

We submitted our model yesterday, and it's currently around 70th in the queue. The total number of evaluations completed doesn't seem to have progressed. I understand that there are large models and that it takes time to complete the benchmarks. However, is this the normal and expected speed?

Open LLM Leaderboard org

Hi ! Sorry for the inconvenience, the queue was in fact stopped for a few days, but it's running again. Your model should be evaluated soon :)

SaylorTwift changed discussion status to closed

Sign up or log in to comment