ABX-AI
/

Spicy-Laymonade-7B-GGUF-IQ-Imatrix

Not-For-All-Audiences

Inference Endpoints

Model card Files Files and versions Community

ABX-AI commited on May 1

Commit

5dabe5b

•

1 Parent(s): 5fb93f3

Update README.md

Files changed (1) hide show

README.md +2 -0

README.md CHANGED Viewed

@@ -11,6 +11,8 @@ license: other
 ---
 # GGUF / IQ / Imatrix for [Spicy-Laymonade-7B](https://huggingface.co/ABX-AI/Spicy-Laymonade-7B)
 ![image/png](https://cdn-uploads.huggingface.co/production/uploads/65d936ad52eca001fdcd3245/bMW7mRqBS_xQJBXn-szWS.png)
 **Why Importance Matrix?**

 ---
 # GGUF / IQ / Imatrix for [Spicy-Laymonade-7B](https://huggingface.co/ABX-AI/Spicy-Laymonade-7B)
+Adding GGUF as I noticed the HF model had a lot of downloads but I never quantized it originally.
 ![image/png](https://cdn-uploads.huggingface.co/production/uploads/65d936ad52eca001fdcd3245/bMW7mRqBS_xQJBXn-szWS.png)
 **Why Importance Matrix?**