Max context length
#24
by
viren-takia
- opened
The max context length seems to be 2048 tokens.
Is there a way to increase this, such as sliding window or rope scaling?
Hello @viren-takia !
You should be able to extend the max context if you keep generating more thna 2048 tokens.
Regards,
Gustavo.
gugarosa
changed discussion status to
closed
But that doesn't actually extend the context window, right?