Removing FAILED models

#701
by MaziyarPanahi - opened

Hi @clefourrier ,

Could you please merge these failed attempts? I am restricted by the 7-day rule, and this would really help.

https://huggingface.co/datasets/open-llm-leaderboard/requests/discussions

Thank you 🤗

Hugging Face H4 org
edited 14 days ago

Hi!
The 7-day rule system exists to prevent people from submitting lots of evaluations of low quality models without putting much care in them.

If we need us to look at the logs of specific models and relaunch them, we'll definitely do so, feel free to reopen and ask @alozowski if you need this. However, we won't remove failed evaluation from someone's quota - you "spent" some of our compute on those already :)

clefourrier changed discussion status to closed

Understood, thanks @clefourrier

Sign up or log in to comment