Some models are tagged with incorrect model types

#806
by scinerd68 - opened

I think some models that are incorrectly tagged. For example, Qwen 2-72B should be pretrained and not "fine tuned on specific domain", the gpt-2 model with float16 precision should also be "pretrained".
There are also some models I'm unsure about, like Qwen 2-72B-Instruct which I think should be "chat models".
If there are any more models that you think are wrongly tagged, comment below.

Open LLM Leaderboard org

@alozowski if you have the time to take a look :)
It's either a request issue or a parser issue

Open LLM Leaderboard org

I'm here!

I fixed gpt2 model in float16 precision model type as well as Qwen2 model types, please, check out my screenshots

Screenshot 2024-07-02 at 15.30.31.png
Screenshot 2024-07-02 at 15.21.05.png

Open LLM Leaderboard org

I close this discussion, I hope all model types are correct so far ☺️

Feel free to open a new discussion and tag me to fix them!

alozowski changed discussion status to closed

Sign up or log in to comment