Spaces:
Running
on
CPU Upgrade
dnhkng/RYS-XLarge has successfully finished, but is shown in requests log as failed and pending
request file: https://huggingface.co/datasets/open-llm-leaderboard/requests/commits/main/dnhkng/RYS-XLarge_eval_request_False_bfloat16_Original.json
result file: https://huggingface.co/datasets/open-llm-leaderboard/results/tree/main/dnhkng/RYS-XLarge
also, it should be a 💬 chat, not a 🟢 pretrained model,
it's based on MaziyarPanahi/calme-2.1-qwen2-72b
Keep in mind, dnhkng/RYS-XLarge model just turned gated. If I am not mistaken, either private or gated models are not allowed on the leaderboard. So it might disappear on the next restart.
Unless I am wrong?
@alozowski
nvm, it's no longer gated :)
Hi @CombinHorizon ,
I changed the type of the model to "chat", please, check the Leaderboard.
For the request file, the model was resubmitted and is currently re-running the evaluation – unfortunately, I can't say exactly why, but you shouldn't be worry, the numbers shouldn't change
I close this discussion, please, feel free to ping me here if you have more questions or open a new discussion