Lewdiculous
/

Sonya-7B-GGUF-IQ-Imatrix

Model card Files Files and versions Community

Lewdiculous commited on Mar 16

Commit

f2d4622

•

1 Parent(s): b76ac4a

Update README.md

Files changed (1) hide show

README.md +7 -1

README.md CHANGED Viewed

@@ -1,4 +1,10 @@
 ---
 license: cc-by-4.0
 ---
-Quantizing and uploading...

 ---
 license: cc-by-4.0
 ---
+Quantizing and uploading...
+```python
+    quantization_options = [
+        "Q4_K_M", "Q4_K_S", "IQ4_XS", "Q5_K_M", "Q5_K_S",
+        "Q6_K", "Q8_0", "IQ3_M", "IQ3_S", "IQ3_XXS"
+    ]
+```