Expanding the window size
#12
by
agershun
- opened
Is there any way to increase the size of the context window for this LLM?
There are some solutions for Mistal to expand the window size to 8K or 16K. Are they applicable to this model?
Since we are using the llama2 architecture, there are numerous ways to expand. 🛠️
hunkim
changed discussion status to
closed