Text Generation
Transformers
Safetensors
English
llama
conversational
Inference Endpoints
text-generation-inference

Please release a 16k version

#27
by Hoioi - opened

Would it be possible for you to modify and release this model with a larger context size, such as 8k or preferably 16k?
The current context size of 4k no longer adequately meets the requirements of the majority of users.

upstage org

We'll be working on it. Our 16K beta API is now available at https://console.upstage.ai. Check it out! 😊

hunkim changed discussion status to closed

When are you going to publish the 16k version publicly on huggingface?

Sign up or log in to comment