meta-llama/Llama-2-70b-hf is set as "Private or deleted"

#580
by TNTOutburst - opened

Is meta-llama/Llama-2-70b-hf supposed to be removed from the leaderboard? Feel it should be added back.

deleted

@TNTOutburst It seems all of Meta's LLMs are private or deleted. For example, Llama-2-70b-chat and Llama-2-13b-chat-hf.

Does that mean I cannot access their scores in the leaderboard?

deleted

@feiba54 if you un-select "private or deleted" from the "Hide models" section of the leaderboard then they will show up in the results.

Open LLM Leaderboard org

Hi! This is happening because their models are gated, and request a valid token for access - I'll try to see why it's no longer working, thanks for the report

Open LLM Leaderboard org

Hi! I ended up hardcoding something specifically for these models as they are too important to the community to be hidden when our scripts fail.
Feel free to reopen if it fails again, but hopefully these specific models should no longer disappear.

clefourrier changed discussion status to closed

Sign up or log in to comment