Base model "meta-llama/Llama-2-13b-hf" was not found on hub!

#224
by Cartinoe5930 - opened

We fine-tuned meta-llama/Llama-2-13b-hf model with filtered Alpaca dataset, and we tried to upload our model trained with PEFT(QLoRA) on Open LLM Leaderboard. But the error occurred as the title. How do we solve this problem?

Open LLM Leaderboard org
edited Aug 24, 2023

Hi!
Since the meta-llama Llama2 models are gated, they cannot be used as base model for the leaderboard (the leaderboard does not have automatic access to it).
Best solution for you would be to merge the weights (which the license allows you to do) and upload as "base" model.

Cartinoe5930 changed discussion status to closed

Sign up or log in to comment