Text Generation
Transformers
Safetensors
llama
conversational
Inference Endpoints
text-generation-inference

Smaug-LLaMa-3-8B-Instruct in the works?

#3
by Joseph717171 - opened

Will you guys make an 8B version too? Please ๐Ÿ™ ๐Ÿ˜‹

Abacus.AI, Inc. org

Actually we already have one! https://huggingface.co/abacusai/Llama-3-Smaug-8B This doesn't have instruct in the name but it is an instruct model. Although we have improved on the recipe since the 8B release so we might update it soon...

Actually we already have one! https://huggingface.co/abacusai/Llama-3-Smaug-8B This doesn't have instruct in the name but it is an instruct model. Although we have improved on the recipe since the 8B release so we might update it soon...

I think they wanted Smaug 8B trained on LLama 8B Instruct instead of the base model. Models trained on instruct tend to do a lot better, as I'm sure you have noticed with Smaug 70B Instruct.

Abacus.AI, Inc. org

It was trained on Llama 8B Instruct! We just didn't say so in the model card. I've fixed that now.

Joseph717171 changed discussion title from Smaug-LLaMa-8B-Instruct in the works? to Smaug-LLaMa-3-8B-Instruct in the works?

@ArkaAbacus
May I ask if you are already planning to update the 8B model with the new recipe and if you have an approximate ETA?
No hurry, I'm just planning to make my own quantization for the ollama library and would like to avoid the new model comes out the day after I'm done with it :P

Sign up or log in to comment