InferenceIllusionist
/

Mistral-7B-v0.2-iMat-GGUF

Inference Endpoints

Model card Files Files and versions Community

InferenceIllusionist commited on Mar 24, 2024

Commit

a82b1a3

·

verified ·

1 Parent(s): d38ec4c

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -15,7 +15,7 @@ tags:
 Mistral 7B v0.2 iMat GGUF quantized from fp16 with love.
 * iMat dat file created using groups_merged.txt
-* Not sure what to expect from this model by itself but uploading to repo incase anyone is curious like me
 <b>Legacy quants (i.e. Q8, Q5_K_M) in this repo have all been enhanced with importance matrix calculation. These quants show improved KL-Divergence over their static counterparts.</b>

 Mistral 7B v0.2 iMat GGUF quantized from fp16 with love.
 * iMat dat file created using groups_merged.txt
+* Not sure what to expect from this model by itself but uploading to repo in case anyone is curious like me
 <b>Legacy quants (i.e. Q8, Q5_K_M) in this repo have all been enhanced with importance matrix calculation. These quants show improved KL-Divergence over their static counterparts.</b>