What is the context size of this model?
#5
by
Okki
- opened
What is the context size of this model? I use a clean llama.cpp so I need to fill it manually.
You can see that in config.json
32768
original qwen2 can be rope scaled to 128k, maybe it will work with this model too.
You can see that in config.json
32768
original qwen2 can be rope scaled to 128k, maybe it will work with this model too.
Thanks, man! You not only gave me a fish but also a fishing rod. I appreciate it.
Okki
changed discussion status to
closed