Spaces:

open-llm-leaderboard

/

open_llm_leaderboard

like 10.6k

Restarting on CPU Upgrade

Hi!
Could you please link to the request file? There are many reasons why this could have happened :)

Here is one of them.

https://huggingface.co/datasets/open-llm-leaderboard/requests/blob/main/migtissera/Tess-Medium-200K-v1.0_eval_request_False_float16_Original.json

Status lists as failed. Same with deepseek instruct.

The specific model you linked was cancelled (because a more important job was launched on the cluster) and automatically requeued - we're apparently still having a small issue with our display.

Hi ! Your model actually failed because of network error on our side, I will re-add it to the queue, thanks for your patience :)

Thank you @SaylorTwift

These three models have failed as well, and no idea why

1. https://huggingface.co/migtissera/Tess-XL-v1.0
2. https://huggingface.co/migtissera/SynthIA-7B-v2.0
3. https://huggingface.co/migtissera/SynthIA-70B-v1.5
   Could you please take a look @SaylorTwift

Hi @migtissera ,
You'll find the request files for your models here. If you point to them next time, we'll be able to debug your problems faster, as they contain the job id which allows us to look at the logs :)
The first model failed because the launching system had a problem launching this big a model (we will need to launch it on multiple nodes).
The other two were cancelled for priority reasons, I'll let @SaylorTwift tell you if they were rescheduled (and relaunch them if not) - the cluster is very full at the moment though, so it might take some time before they are evaluated.

Thanks @clefourrier ! I didn't know where to find this.. Will do this from next one onwards.. :)

I'm going to close this issue for now, feel free to reopen if needed