Poor results when changing context window
#2
by
mallorbc
- opened
When I change the context window to something like 4096, I get poor results(repeating tokens), even well before the original 2048 limit. When I leave it at the default, this behavior is not seen.
I am using the model as is. Do I need to finetune to achieve good results?