bluuwhale
/

KukulStanta-7B-8bpw-exl2

Text Generation

Inference Endpoints

text-generation-inference

8-bit precision

Model card Files Files and versions Community

bluuwhale commited on Apr 11

Commit

29162f8

•

1 Parent(s): 5829a30

Update README.md

Files changed (1) hide show

README.md +2 -0

README.md CHANGED Viewed

@@ -106,6 +106,8 @@ model-index:
 ---
 ![image/png](https://cdn-uploads.huggingface.co/production/uploads/642265bc01c62c1e4102dc36/NYX3IOR6Ctf9PDQiXIg9d.png)
 # Vision/multimodal capabilities:
 Quants Found Here: https://huggingface.co/Lewdiculous/KukulStanta-7B-GGUF-IQ-Imatrix

 ---
 ![image/png](https://cdn-uploads.huggingface.co/production/uploads/642265bc01c62c1e4102dc36/NYX3IOR6Ctf9PDQiXIg9d.png)
+Just trying to quantize this model into exl. I provide `measurement.json` on the repo if you want to quantize it yourself
 # Vision/multimodal capabilities:
 Quants Found Here: https://huggingface.co/Lewdiculous/KukulStanta-7B-GGUF-IQ-Imatrix