Is this only a 2k context model? And what about the unquantized version is it the same?
This is an 8K context length model.
Thank you
You should update the readme and mention that it has an 8k context window
· Sign up or log in to comment