Context Size?
#1
by
jasonmbrown
- opened
Just wondering what the context size limit is for this model, currently I have it set at 4k.
As a side note, I would just like to compliment how well this model runs, it is very good at figuring out commands, and is the first model at its size point that is able to handle multicharacter scenarios properly without needing a different context for each character.
thank you for the compliment (^.^)
the preferred context size for this model is 8k