Could not get your model information. Please fill it up properly.

#873
by legolasyiu - opened

I try to submit this model and I always getting error message : Could not get your model information. Please fill it up properly.

Model: EpistemeAI/Llama-3.1-8B-dpo
Can you check to see why the open llm leaderboard submission is not allow this model?

Open LLM Leaderboard org

Hi @legolasyiu ,

Could you please send the link to this model?

Open LLM Leaderboard org

Thank you for sending the model link!

I checked the model card, it's fine and I've submitted this model for the evaluation myself, please, check out the request file

I close this discussion, please, ping me here in case of any other questions or start a new discussion

alozowski changed discussion status to closed

Why did it failed?

EpistemeAI/Llama-3.1-8B-ORPO

alozowski changed discussion status to open
Open LLM Leaderboard org

Hi @legolasyiu ,

I'm afraid this problem is on our side as we are updating the Leaderboard backend. I've resubmitted the model and will keep an eye on it. I will leave this discussion open for a while

Any update with benchmark?

I will be submitting much more powerful model. I will keep you posted. Hopefully it will have very good score

I want to submit this one:

EpistemeAI/Fireball-Llama-3.11-8B-v1orpo

Open LLM Leaderboard org

Hi @legolasyiu ,

I resubmitted EpistemeAI/Llama-3.1-8B-ORPO as it failed again, unfortunately. For the updates, you can check the status in the request file.

If you want to submit a model, please, use our documentation, "How to submit models" section

I close this discussion, please, feel free to open a new one in case of any question

alozowski changed discussion status to closed

Sign up or log in to comment