what is difference between Q4_K_M and Q4_K_S?

#56
by Clausss - opened

same as title

ggml.ai org

You can find more information about the quants and their reference here: https://huggingface.co/docs/hub/gguf#quantization-types

Cheers!

reach-vb changed discussion status to closed

Sign up or log in to comment