Any chance of increasing the context?
#2
by
dazl1212
- opened
Would be great with 16k context or above.
Hey
@dazl1212
,
I'm not sure if I can do 16K, but 8K might be possible now (RoPE the rest maybe?) with Fimbulvetr-11B-v2.1. I can whip that up for you with a few GGUFs if you like?
Thanks for trying my model! Have good day! :)
Hi mate, that would be awesome. 8k with Chaifighter-20B-v2 will fit my needs great!
Hey
@dazl1212
,
I'm uploading the tweaked model right now. In the meantime, please let me know if you need anything else. :)
Have a great day!
Brilliant! Thank you!