Lewdiculous
/

Sonya-7B-GGUF-IQ-Imatrix

Inference Endpoints

Model card Files Files and versions Community

Lewdiculous commited on Mar 16

Commit

ffc4526

•

1 Parent(s): 5f6f640

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -1,7 +1,7 @@
 ---
 license: cc-by-4.0
 ---
-Quantizing and uploading...
 ```python
     quantization_options = [
         "Q4_K_M", "Q4_K_S", "IQ4_XS", "Q5_K_M", "Q5_K_S",

 ---
 license: cc-by-4.0
 ---
+Quants:
 ```python
     quantization_options = [
         "Q4_K_M", "Q4_K_S", "IQ4_XS", "Q5_K_M", "Q5_K_S",