rope-freq-base

#1
by shantanu - opened

The readme says we should set it to 10000. Are we sure this shouldn't be 1e6?

Yeah sorry I needed to update that. Yes the value is 1e6 but in fact you don't need to set it manually for GGUF, because the correct value is baked into the GGUF file automatically.

I've edited my CodeLlama GGUF READMEs to remove mention of manually setting rope-freq-base.

Sign up or log in to comment