Context size?
#1
by
MichaelBui
- opened
Is it 2k or 8k context size? Thanks 🙏
It's a Llama 2 model so it's 4K. But you can also try NTK scaling to increase that dynamically
Is it 2k or 8k context size? Thanks 🙏
It's a Llama 2 model so it's 4K. But you can also try NTK scaling to increase that dynamically