How many tokens of context can this model handle?

#1
by rombodawg - opened

Is this only a 2k context model? And what about the unquantized version is it the same?

This is an 8K context length model.

You should update the readme and mention that it has an 8k context window

Sign up or log in to comment