Model not visible on leaderboard

#489
by mwitiderrick - opened

I submitted this model mwitiderrick/open_llama_3b_glaive_assistant_v0.1, the evaluation finished and it's not visible on the leaderboard.

The model is not flagged, not private, and not deleted.

The link to the details page gives a 404 https://huggingface.co/datasets/open-llm-leaderboard/details_mwitiderrick__open_llama_3b_glaive_assistant_v0.1

There is no folder for the model in my directory https://huggingface.co/datasets/open-llm-leaderboard/results/tree/main/mwitiderrick

Update:
Found that it failed https://huggingface.co/datasets/open-llm-leaderboard/requests/commit/70b912b03fd309b689eb045e2496ed2554a2561a

mwitiderrick changed discussion status to closed
mwitiderrick changed discussion status to open

Tried a second time and it also failed mwitiderrick/open_llama_3b_glaive_v0.1

I can load the model using transformers and perform inference

Open LLM Leaderboard org

Hi!
We are investigating problems with connection issues because we changed the eval cluster - we hope they'll be resolved by tonight CET and we'll make sure to relaunch all models which failed in the meantime, thank you for your patience

Open LLM Leaderboard org

Hi ! The issue should be fixed, I requeued your model :)

SaylorTwift changed discussion status to closed

Sign up or log in to comment