bartowski

/

DeepSeek-V2.5-1210-GGUF

like 9

Thanks for the GGUFs as always! Just a question:
The original model has 160k context length. I'm not familiar with all the rope_freq_base and compress_pos_emb settings, but something seems off.
I do believe that it's possible to get more than 4k context out of this, but don't really know 100% how?