Add license/commercial use column?

#12
by fireforge - opened

It would help if models could be listed and sorted by the license that they are released under, or possibly just a simple "commercial use allowed" yes/no column. This is very relevant at the moment since most of the top models have this restriction.

Agreed. And this should depend not only on the model license, but also on the instruction finetuning dataset. For instance, GPT4All is trained on ChatGPT conversations, which as per 2.c.iii in OpenAI's usage requirements (https://openai.com/policies/terms-of-use) cannot be used to create competing models with OpenAI, which GPT4All is.

This is critical. I hope it gets the attention it deserves

I actually think these models should be REMOVED from the OPEN LLM leaderboard. It's not really open if you've got restrictions. This goes for datasets as well.

This board has just become an advertisement board instead of something useful for everyone. Top ranking model? Oh, you need to pay for that. Other top models? Oh, you can't really use those due to being TOS encumbered.

Rename board to "Research LLM leaderboard" or drop the non-open models and models that use non-open datasets. These aren't open.

Hi! The model license column has been added, I hope it will be useful for you 🤗

clefourrier changed discussion status to closed

Sign up or log in to comment