On model size filtering

#230
by thomwolf HF staff - opened
Open LLM Leaderboard org

Three quick reports / proposals:

  • when I filter with 3, I also get the models with 1.3 in the list
  • models around 1B should include the big category of models with 1.3B parameters
  • I would be interesting for both model type (pretrained/fine-tuned/Etc) and model size to have a multiple checklist instead of a toggle to be able to filter out just some models. In this case it would be nice that the various bins are in contact with each other to cover all the scale
Open LLM Leaderboard org
edited Aug 28, 2023

Here are the bins for the numerical filtering:

            "all": (0, 10000),
            "< 1B": (0, 1),
            "~3B": (1, 5),
            "~7B": (6, 11),
            "~13B": (12, 15),
            "~35B": (16, 55),
            "60B+": (55, 10000),

So it's normal you get 1.3 with 3. I'll change the first bin to go up to 1.5B.

I like the checkbox idea for the toggles, I'll add it.

Open LLM Leaderboard org

Feature added, closing :)

clefourrier changed discussion status to closed

Sign up or log in to comment