Text Generation
Transformers
Safetensors
llama
conversational
Inference Endpoints
text-generation-inference

Any news about the updated model with the latest recipe?

#5
by ManniX-ITA - opened

@ArkaAbacus
Any news about when will be eventually released?
I'd like to add some more quants in the ollama library but as said I'd like to avoid it doing twice.

The latest 70b with 32k context seems better than the model without.
Would be nice if also the 8B could come with the 32k context exetension.

Thanks!

Abacus.AI, Inc. org
β€’
edited 10 days ago

Hi there, sorry for the slow response on this. 32k context 8B is not on our immediate roadmap. I could try to squeeze this in potentially in the next week or so, but I wouldn't necessarily count on it happening for sure.

No problem, I have uploaded it already. When it comes out, I'll be glad to upload the new one!

Sign up or log in to comment