what does imatrix do to the model?
#1
by
Samvanity
- opened
Hi,
How is this different from a regular gguf? is imatrix a finetuning method or?
@Samvanity imatrix training it improves the perplexity of IQ quants closer to the original q8_0. imatrix command is from llama.cpp
Bakanayatsu
changed discussion status to
closed