Model "Amu/dpo-qlora-Qwen1.5-0.5B-Chat-xtuner" was not found or misconfigured on the hub!

#772
by Amu - opened

It's a weird error, when I try to submit my model: https://huggingface.co/Amu/dpo-qlora-Qwen1.5-0.5B-Chat-xtuner

I test it with this python script successfully:

from transformers import AutoConfig, AutoModel, AutoTokenizer
save_dir = 'Amu/dpo-qlora-Qwen1.5-0.5B-Chat-xtuner'
config = AutoConfig.from_pretrained(save_dir)
tokenizer = AutoTokenizer.from_pretrained(save_dir)

And I can find it on the website: https://huggingface.co/models?sort=trending&search=Amu%2Fdpo- .

But when I try to submit it on the llm leaderboard, there is a error like this:

截屏2024-06-01 22.29.46.png

I don't know how to fix it. And I just change my user name form amu to Amu. Is it related with this error?

Can someone help me to tell me how can I fix it? thanks!

running into this same issue I had raised earlier https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard/discussions/771#665a6358dd6389e91a6c70d2 please let me know if you figure out something because it has been driving me crazy

https://huggingface.co/blog/space-secrets-disclosure

As a first step of remediation, we have revoked a number of HF tokens present in those secrets.

And they haven't replaced the key yet.

https://huggingface.co/blog/space-secrets-disclosure

As a first step of remediation, we have revoked a number of HF tokens present in those secrets.

And they haven't replaced the key yet.

@clefourrier

I can confirm I am dealing with same error where model https://huggingface.co/pankajmathur/orca_mini_v6_8b is shown listed https://huggingface.co/models?pipeline_tag=text2text-generation&sort=modified but during submission to LB it throws same error.
"Model "pankajmathur/orca_mini_v6_8b" was not found or misconfigured on the hub! Error raised was pankajmathur/orca_mini_v6_8b is not a local folder and is not a valid model identifier listed on 'https://huggingface.co/models' If this is a private repository, make sure to pass a token having permission to this repo either by logging in with huggingface-cli login or by passing token="

@clefourrier I also got email this morning that my write token was revoked. so not sure it is related to this error. if it not sure what is the next step.

Here are screenshots,
Screenshot 2024-06-01 at 11.27.36 PM.png
Screenshot 2024-06-01 at 11.28.52 PM.png

No it is definitely an issue I am getting the same error when trying to submit and my tokens are fine. There seems to be something wrong with the leaderboard submission form app.

Open LLM Leaderboard org

Hi all!
We had already rotated our tokens last weeks, so I think it's unrelated - I'll take a look rn

Open LLM Leaderboard org

Could you folks retry and tell me what you get now?

Essentially back to normal availability, with the notable exception that submissions are no longer being accepted for gated models.

Open LLM Leaderboard org

OK, cool!
Closing for now then, thanks for testing

clefourrier changed discussion status to closed

Sign up or log in to comment