Commit
•
14cab28
1
Parent(s):
352e303
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -240,14 +240,14 @@ Link: [here](https://huggingface.co/legraphista/Llama-3.2-3B-Instruct-IMat-GGUF/
|
|
| 240 |
| [Llama-3.2-3B-Instruct.Q8_0.gguf](https://huggingface.co/legraphista/Llama-3.2-3B-Instruct-IMat-GGUF/blob/main/Llama-3.2-3B-Instruct.Q8_0.gguf) | Q8_0 | 3.42GB | ✅ Available | ⚪ Static | 📦 No
|
| 241 |
| [Llama-3.2-3B-Instruct.Q6_K.gguf](https://huggingface.co/legraphista/Llama-3.2-3B-Instruct-IMat-GGUF/blob/main/Llama-3.2-3B-Instruct.Q6_K.gguf) | Q6_K | 2.64GB | ✅ Available | ⚪ Static | 📦 No
|
| 242 |
| [Llama-3.2-3B-Instruct.Q4_K.gguf](https://huggingface.co/legraphista/Llama-3.2-3B-Instruct-IMat-GGUF/blob/main/Llama-3.2-3B-Instruct.Q4_K.gguf) | Q4_K | 2.02GB | ✅ Available | 🟢 IMatrix | 📦 No
|
| 243 |
-
| Llama-3.2-3B-Instruct.Q3_K | Q3_K |
|
| 244 |
| Llama-3.2-3B-Instruct.Q2_K | Q2_K | - | ⏳ Processing | 🟢 IMatrix | -
|
| 245 |
|
| 246 |
|
| 247 |
### All Quants
|
| 248 |
| Filename | Quant type | File Size | Status | Uses IMatrix | Is Split |
|
| 249 |
| -------- | ---------- | --------- | ------ | ------------ | -------- |
|
| 250 |
-
| Llama-3.2-3B-Instruct.BF16 | BF16 |
|
| 251 |
| Llama-3.2-3B-Instruct.FP16 | F16 | - | ⏳ Processing | ⚪ Static | -
|
| 252 |
| [Llama-3.2-3B-Instruct.Q8_0.gguf](https://huggingface.co/legraphista/Llama-3.2-3B-Instruct-IMat-GGUF/blob/main/Llama-3.2-3B-Instruct.Q8_0.gguf) | Q8_0 | 3.42GB | ✅ Available | ⚪ Static | 📦 No
|
| 253 |
| [Llama-3.2-3B-Instruct.Q6_K.gguf](https://huggingface.co/legraphista/Llama-3.2-3B-Instruct-IMat-GGUF/blob/main/Llama-3.2-3B-Instruct.Q6_K.gguf) | Q6_K | 2.64GB | ✅ Available | ⚪ Static | 📦 No
|
|
@@ -257,7 +257,7 @@ Link: [here](https://huggingface.co/legraphista/Llama-3.2-3B-Instruct-IMat-GGUF/
|
|
| 257 |
| Llama-3.2-3B-Instruct.Q4_K_S | Q4_K_S | - | ⏳ Processing | 🟢 IMatrix | -
|
| 258 |
| Llama-3.2-3B-Instruct.IQ4_NL | IQ4_NL | - | ⏳ Processing | 🟢 IMatrix | -
|
| 259 |
| Llama-3.2-3B-Instruct.IQ4_XS | IQ4_XS | - | ⏳ Processing | 🟢 IMatrix | -
|
| 260 |
-
| Llama-3.2-3B-Instruct.Q3_K | Q3_K |
|
| 261 |
| Llama-3.2-3B-Instruct.Q3_K_L | Q3_K_L | - | ⏳ Processing | 🟢 IMatrix | -
|
| 262 |
| Llama-3.2-3B-Instruct.Q3_K_S | Q3_K_S | - | ⏳ Processing | 🟢 IMatrix | -
|
| 263 |
| Llama-3.2-3B-Instruct.IQ3_M | IQ3_M | - | ⏳ Processing | 🟢 IMatrix | -
|
|
|
|
| 240 |
| [Llama-3.2-3B-Instruct.Q8_0.gguf](https://huggingface.co/legraphista/Llama-3.2-3B-Instruct-IMat-GGUF/blob/main/Llama-3.2-3B-Instruct.Q8_0.gguf) | Q8_0 | 3.42GB | ✅ Available | ⚪ Static | 📦 No
|
| 241 |
| [Llama-3.2-3B-Instruct.Q6_K.gguf](https://huggingface.co/legraphista/Llama-3.2-3B-Instruct-IMat-GGUF/blob/main/Llama-3.2-3B-Instruct.Q6_K.gguf) | Q6_K | 2.64GB | ✅ Available | ⚪ Static | 📦 No
|
| 242 |
| [Llama-3.2-3B-Instruct.Q4_K.gguf](https://huggingface.co/legraphista/Llama-3.2-3B-Instruct-IMat-GGUF/blob/main/Llama-3.2-3B-Instruct.Q4_K.gguf) | Q4_K | 2.02GB | ✅ Available | 🟢 IMatrix | 📦 No
|
| 243 |
+
| [Llama-3.2-3B-Instruct.Q3_K.gguf](https://huggingface.co/legraphista/Llama-3.2-3B-Instruct-IMat-GGUF/blob/main/Llama-3.2-3B-Instruct.Q3_K.gguf) | Q3_K | 1.69GB | ✅ Available | 🟢 IMatrix | 📦 No
|
| 244 |
| Llama-3.2-3B-Instruct.Q2_K | Q2_K | - | ⏳ Processing | 🟢 IMatrix | -
|
| 245 |
|
| 246 |
|
| 247 |
### All Quants
|
| 248 |
| Filename | Quant type | File Size | Status | Uses IMatrix | Is Split |
|
| 249 |
| -------- | ---------- | --------- | ------ | ------------ | -------- |
|
| 250 |
+
| [Llama-3.2-3B-Instruct.BF16.gguf](https://huggingface.co/legraphista/Llama-3.2-3B-Instruct-IMat-GGUF/blob/main/Llama-3.2-3B-Instruct.BF16.gguf) | BF16 | 6.43GB | ✅ Available | ⚪ Static | 📦 No
|
| 251 |
| Llama-3.2-3B-Instruct.FP16 | F16 | - | ⏳ Processing | ⚪ Static | -
|
| 252 |
| [Llama-3.2-3B-Instruct.Q8_0.gguf](https://huggingface.co/legraphista/Llama-3.2-3B-Instruct-IMat-GGUF/blob/main/Llama-3.2-3B-Instruct.Q8_0.gguf) | Q8_0 | 3.42GB | ✅ Available | ⚪ Static | 📦 No
|
| 253 |
| [Llama-3.2-3B-Instruct.Q6_K.gguf](https://huggingface.co/legraphista/Llama-3.2-3B-Instruct-IMat-GGUF/blob/main/Llama-3.2-3B-Instruct.Q6_K.gguf) | Q6_K | 2.64GB | ✅ Available | ⚪ Static | 📦 No
|
|
|
|
| 257 |
| Llama-3.2-3B-Instruct.Q4_K_S | Q4_K_S | - | ⏳ Processing | 🟢 IMatrix | -
|
| 258 |
| Llama-3.2-3B-Instruct.IQ4_NL | IQ4_NL | - | ⏳ Processing | 🟢 IMatrix | -
|
| 259 |
| Llama-3.2-3B-Instruct.IQ4_XS | IQ4_XS | - | ⏳ Processing | 🟢 IMatrix | -
|
| 260 |
+
| [Llama-3.2-3B-Instruct.Q3_K.gguf](https://huggingface.co/legraphista/Llama-3.2-3B-Instruct-IMat-GGUF/blob/main/Llama-3.2-3B-Instruct.Q3_K.gguf) | Q3_K | 1.69GB | ✅ Available | 🟢 IMatrix | 📦 No
|
| 261 |
| Llama-3.2-3B-Instruct.Q3_K_L | Q3_K_L | - | ⏳ Processing | 🟢 IMatrix | -
|
| 262 |
| Llama-3.2-3B-Instruct.Q3_K_S | Q3_K_S | - | ⏳ Processing | 🟢 IMatrix | -
|
| 263 |
| Llama-3.2-3B-Instruct.IQ3_M | IQ3_M | - | ⏳ Processing | 🟢 IMatrix | -
|