I submitted my model a while ago and it never got benchmarked

#644
by rombodawg - opened

I submitted the rombodawg/EveryoneLLM-7b-Gemma-Base model a while ago, and when i submit it again it says "already submitted" But the model is nowhere to be seen on the leaderboard. Can we please rerun the test, or find where the results are?

https://huggingface.co/rombodawg/EveryoneLLM-7b-Gemma-Base

@rombodawg Just adding a link to the request file because the FAQ said it helps them track down the issue. The status says failed for some reason.

https://huggingface.co/datasets/open-llm-leaderboard/requests/blob/main/rombodawg/EveryoneLLM-7b-Gemma-Base_eval_request_False_float16_Original.json

Hugging Face H4 org

Hi!
Thanks a lot @Phil337 for the request link :)
@rombodawg , your model's evaluation was cancelled because a higher priority job was launched - they are usually rescheduled but our slurm job manager crashed a couple days ago. I passed your job to pending again and it should run again soon!
Btw, it could be useful for you to read the FAQ, it would have answered some of your questions and pointed you to the request file :)

Feel free to reopen if there is an issue later.

clefourrier changed discussion status to closed

Sign up or log in to comment