Feature request: Adding model architecture as a column

#335
by barinov274 - opened

Can you add model architecture as a column?

Open LLM Leaderboard org

Hi! What would you want to see in such a column?

clefourrier changed discussion title from can you add model architecture to Feature request: Adding model architecture as a column

When you open config.json file of any transformers model, there's a field

...
"architectures": [
    "StableLMEpochForCausalLM"
  ],
...

I want to be able to filter models by available architectures in the field and see what architectures a model use.

+1, this would also be useful for filtering out models with restrictive licenses (ie Llama2) for which the license field of derivative models is often mislabeled as free

Open LLM Leaderboard org

Ty for the suggestion! I think it's quite cool.
It's not going to be on top of the roster while we're working on the big leaderboard upgrade, but I'll add it afterwards!

Open LLM Leaderboard org

@barinov274 @monology , it's up and running, look for the "Architecture" column selector!
Hope you enjoy the new feature :)

clefourrier changed discussion status to closed

Sign up or log in to comment