thank you
#1
by
ehartford
- opened
I couldn't get it to quantize,
If you get it working can you please share the command you used?
np after a git pull and rebuild of llama.cpp I followed this
https://qwen.readthedocs.io/en/latest/quantization/gguf.html