Spaces:
Running
on
CPU Upgrade
Model Failure
All the models I submitted failed. Can I know the detailed reason? Even though I followed the steps in About, they all failed.
Thank you!
https://huggingface.co/datasets/open-llm-leaderboard/requests/blob/main/bongchoi/MoMo-70B-LoRA-V1.0_eval_request_False_float16_Adapter.json
https://huggingface.co/datasets/open-llm-leaderboard/requests/blob/main/bongchoi/MoMo-70B-V1.0_eval_request_False_float16_Original.json
https://huggingface.co/datasets/open-llm-leaderboard/requests/blob/main/bongchoi/MoMo-70B-V1.1_eval_request_False_float16_Original.json
Hi!
We have a new system to run our evaluations on the HF cluster, where the leaderboard evaluations get cancelled automatically if a higher priority job needs resources.
The jobs get relaunched automatically in the end, but they get displayed as failed in the meantime (for example, I just checked and the first model you linked is running atm).
We'll try to improve our logging!
@SaylorTwift FYI