Text Generation
Transformers
Safetensors
llama
Not-For-All-Audiences
nsfw
Inference Endpoints
text-generation-inference
Nice model
#4
by
Diavator
- opened
This post is more of a request than a review. Can you make 20B models with a 16k context?
If I want to do that, I would need base model that take more context into account, maybe in the future, but not planned for now. Sorry!
That's too bad. You have good models and more context would have made them even better for RP fans. You can use airoboros as a base, as far as I know there is 16k context there.
Yeah, still, if all the model don't have bigger context, if will have some issue.
No worry, as soon as I have ressource and model that can go higher, I will try it. Also I don't like the prompting of the last versions of Airoboros, Alpaca for life (for now) heh