Lewdiculous
/

Eris_PrimeV4.69-Vision-32k-7B-GGUF-Imatrix

Model card Files Files and versions Community

Lewdiculous commited on Mar 29

Commit

2f35dd3

•

1 Parent(s): f5ba5e7

Update README.md

Files changed (1) hide show

README.md +6 -0

README.md CHANGED Viewed

@@ -12,6 +12,12 @@ tags:
 **These are quants for an eperimental model.**
 Original model weights and information: <br> https://huggingface.co/Nitral-AI/Eris_PrimeV4.69-Vision-32k-7B
 MMPROJ: <br> [./blob/main/mmproj/mmproj-model-f16.gguf](./blob/main/mmproj/mmproj-model-f16.gguf)

 **These are quants for an eperimental model.**
+    quantization_options = [
+        "Q4_K_M", "Q4_K_S", "IQ4_XS",
+        "Q5_K_M", "Q5_K_S",
+        "Q6_K", "Q8_0"
+    ]
 Original model weights and information: <br> https://huggingface.co/Nitral-AI/Eris_PrimeV4.69-Vision-32k-7B
 MMPROJ: <br> [./blob/main/mmproj/mmproj-model-f16.gguf](./blob/main/mmproj/mmproj-model-f16.gguf)