thank you

#1
by ehartford - opened

I couldn't get it to quantize,
If you get it working can you please share the command you used?

np after a git pull and rebuild of llama.cpp I followed this

https://qwen.readthedocs.io/en/latest/quantization/gguf.html

Sign up or log in to comment