Hugging Face's logo

Quant-Cartel
/
Questionable-MN-12B-iMat-GGUF

Transformers
GGUF
unsloth
trl
sft
iMat
GGUF
Inference Endpoints
imatrix
conversational
Model card Files Community
InferenceIllusionist commited on
Commit
2687403
·
verified ·
1 Parent(s): 131f43d

Upload 3 files

Browse files
Files changed (4) hide show
  1. .gitattributes +3 -0
  2. Questionable-MN-12B-iMat-IQ3_M.gguf +3 -0
  3. Questionable-MN-12B-iMat-IQ4_XS.gguf +3 -0
  4. Questionable-MN-12B-iMat-Q3_K_M.gguf +3 -0
.gitattributes CHANGED
@@ -37,3 +37,6 @@ Questionable-MN-12B-iMat-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
37
  Questionable-MN-12B-iMat-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
38
  Questionable-MN-12B-iMat-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
39
  Questionable-MN-12B-iMat-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
37
  Questionable-MN-12B-iMat-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
38
  Questionable-MN-12B-iMat-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
39
  Questionable-MN-12B-iMat-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Questionable-MN-12B-iMat-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Questionable-MN-12B-iMat-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Questionable-MN-12B-iMat-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Questionable-MN-12B-iMat-IQ3_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3d3a88b40057de9583b3aa05402234c28b179e74a92df391ecdaff4922b4fa2d
3
+ size 5722232896
Questionable-MN-12B-iMat-IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:19ef0a04f5b39f061707fed8a87c41813f609cbf05519c70ebe8869d506a5f74
3
+ size 6742710336
Questionable-MN-12B-iMat-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:58066476482c915b3363125546aafed8edebf75bf48244445c78ba34d9e3d8da
3
+ size 6083090496