Model disappeared from app(I can't find the dataset related with the model either)

#759
by kamilmuratyilmaz - opened

Hello, we had cypienai/cymist-2-v02-SFT in the leaderboard list, it was available to view today but for some reason I can't see the model anymore.

Version 1 of the model is perfectly fine, below is the related dataset;
https://huggingface.co/datasets/open-llm-leaderboard/details_cypienai__cymist2-v01-SFT

V0.2 dataset It was available this morning.

Results folder:
https://huggingface.co/datasets/open-llm-leaderboard/results/tree/main/cypienai/cymist-2-v02-SFT

Thank you in advance!

Additional observations:
When I remove private or deleted model marker I can see the results. Regarding to this, I haven't made private or delete the model.

Open LLM Leaderboard org

This might have happened while we were renaming/moving some files, could you try again?

Unfortunately nothing has changed.

Still only visible via unmark of Private or deleted.
image.png

Below is the marked version;

image.png

Open LLM Leaderboard org

Interesting, we'll take a look this week

Thank you so much @clefourrier

Open LLM Leaderboard org

Hi! There seems to be an issue when parsing your model card, you can try it like so

from huggingface_hub import ModelCard
card = ModelCard.load("cypienai/cymist-2-v02-SFT")

Since it's badly formatted, we can't read it, so it's considered as a "deleted" model (to avoid people submitting models with empty model cards).

Hi! Regarding the feedback, we applied a fix.
Now we can load the card with the given code, we are waiting for the model to appear again on the leaderboard.

Open LLM Leaderboard org

Cool! It should be done automatically, if it's not updated by tomorrow please ping me again :)

It has been done, thank you so much for your help @clefourrier and congrats 10k+ likes on Leaderboard!

clefourrier changed discussion status to closed

Sign up or log in to comment