legraphista
commited on
Commit
•
d1393b9
1
Parent(s):
245b288
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
@@ -180,7 +180,7 @@ Link: [here](https://huggingface.co/legraphista/llm-compiler-7b-IMat-GGUF/blob/m
|
|
180 |
| [llm-compiler-7b.Q6_K.gguf](https://huggingface.co/legraphista/llm-compiler-7b-IMat-GGUF/blob/main/llm-compiler-7b.Q6_K.gguf) | Q6_K | 5.53GB | ✅ Available | ⚪ Static | 📦 No
|
181 |
| [llm-compiler-7b.Q4_K.gguf](https://huggingface.co/legraphista/llm-compiler-7b-IMat-GGUF/blob/main/llm-compiler-7b.Q4_K.gguf) | Q4_K | 4.08GB | ✅ Available | 🟢 IMatrix | 📦 No
|
182 |
| [llm-compiler-7b.Q3_K.gguf](https://huggingface.co/legraphista/llm-compiler-7b-IMat-GGUF/blob/main/llm-compiler-7b.Q3_K.gguf) | Q3_K | 3.30GB | ✅ Available | 🟢 IMatrix | 📦 No
|
183 |
-
| llm-compiler-7b.Q2_K | Q2_K |
|
184 |
|
185 |
|
186 |
### All Quants
|
@@ -203,7 +203,7 @@ Link: [here](https://huggingface.co/legraphista/llm-compiler-7b-IMat-GGUF/blob/m
|
|
203 |
| llm-compiler-7b.IQ3_S | IQ3_S | - | ⏳ Processing | 🟢 IMatrix | -
|
204 |
| llm-compiler-7b.IQ3_XS | IQ3_XS | - | ⏳ Processing | 🟢 IMatrix | -
|
205 |
| llm-compiler-7b.IQ3_XXS | IQ3_XXS | - | ⏳ Processing | 🟢 IMatrix | -
|
206 |
-
| llm-compiler-7b.Q2_K | Q2_K |
|
207 |
| llm-compiler-7b.Q2_K_S | Q2_K_S | - | ⏳ Processing | 🟢 IMatrix | -
|
208 |
| llm-compiler-7b.IQ2_M | IQ2_M | - | ⏳ Processing | 🟢 IMatrix | -
|
209 |
| llm-compiler-7b.IQ2_S | IQ2_S | - | ⏳ Processing | 🟢 IMatrix | -
|
|
|
180 |
| [llm-compiler-7b.Q6_K.gguf](https://huggingface.co/legraphista/llm-compiler-7b-IMat-GGUF/blob/main/llm-compiler-7b.Q6_K.gguf) | Q6_K | 5.53GB | ✅ Available | ⚪ Static | 📦 No
|
181 |
| [llm-compiler-7b.Q4_K.gguf](https://huggingface.co/legraphista/llm-compiler-7b-IMat-GGUF/blob/main/llm-compiler-7b.Q4_K.gguf) | Q4_K | 4.08GB | ✅ Available | 🟢 IMatrix | 📦 No
|
182 |
| [llm-compiler-7b.Q3_K.gguf](https://huggingface.co/legraphista/llm-compiler-7b-IMat-GGUF/blob/main/llm-compiler-7b.Q3_K.gguf) | Q3_K | 3.30GB | ✅ Available | 🟢 IMatrix | 📦 No
|
183 |
+
| [llm-compiler-7b.Q2_K.gguf](https://huggingface.co/legraphista/llm-compiler-7b-IMat-GGUF/blob/main/llm-compiler-7b.Q2_K.gguf) | Q2_K | 2.53GB | ✅ Available | 🟢 IMatrix | 📦 No
|
184 |
|
185 |
|
186 |
### All Quants
|
|
|
203 |
| llm-compiler-7b.IQ3_S | IQ3_S | - | ⏳ Processing | 🟢 IMatrix | -
|
204 |
| llm-compiler-7b.IQ3_XS | IQ3_XS | - | ⏳ Processing | 🟢 IMatrix | -
|
205 |
| llm-compiler-7b.IQ3_XXS | IQ3_XXS | - | ⏳ Processing | 🟢 IMatrix | -
|
206 |
+
| [llm-compiler-7b.Q2_K.gguf](https://huggingface.co/legraphista/llm-compiler-7b-IMat-GGUF/blob/main/llm-compiler-7b.Q2_K.gguf) | Q2_K | 2.53GB | ✅ Available | 🟢 IMatrix | 📦 No
|
207 |
| llm-compiler-7b.Q2_K_S | Q2_K_S | - | ⏳ Processing | 🟢 IMatrix | -
|
208 |
| llm-compiler-7b.IQ2_M | IQ2_M | - | ⏳ Processing | 🟢 IMatrix | -
|
209 |
| llm-compiler-7b.IQ2_S | IQ2_S | - | ⏳ Processing | 🟢 IMatrix | -
|