Increasing upper limit of `Select the number of parameters (B)` to support larger open-source models like `meta-llama/Meta-Llama-3.1-405B-Instruct`

#858

Simple change to increase the slider upper limit to include new larger open-source LLMs

Open LLM Leaderboard org

Following new commits that happened in this PR, the ephemeral Space open-llm-leaderboard/open_llm_leaderboard-ci-pr-858 has been updated.
(This is an automated message.)

Open LLM Leaderboard org

Following new commits that happened in this PR, the ephemeral Space open-llm-leaderboard/open_llm_leaderboard-ci-pr-858 has been updated.
(This is an automated message.)

Open LLM Leaderboard org

Following the creation of this PR, an ephemeral Space open-llm-leaderboard/open_llm_leaderboard-ci-pr-858 has been started. Any changes pushed to this PR will be synced with the test Space.
Since this PR has not been created by a trusted author, the ephemeral Space has not been configured with the correct hardware, storage, and secrets. An admin must configure it manually.
(This is an automated message.)

Open LLM Leaderboard org

Thank you @singhsidhukuldeep for your PR! This is a good idea, but first let me check if the slider works properly with this change

Open LLM Leaderboard org

I checked, the maximum size depends on the maximum size available in the models being evaluated, I'll be able to merge your PR once LLama-405B is on the Leaderboard, as that way I can properly test the slider change

Why is Llama-3.1-405B not on the leaderboard yet?

Open LLM Leaderboard org

Hi @SmartManoj ,

The reason is that >150B models require a multi-node set up. For now, our approach is not stable and doesn't work properly, but we will solve it in the near future to add big models

alozowski changed pull request status to closed

Sign up or log in to comment