legraphista
commited on
Commit
β’
e810a20
1
Parent(s):
5809a10
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
@@ -63,7 +63,7 @@ Link: [here](https://huggingface.co/legraphista/Qwen2.5-72B-Instruct-IMat-GGUF/b
|
|
63 |
| [Qwen2.5-72B-Instruct.Q6_K/*](https://huggingface.co/legraphista/Qwen2.5-72B-Instruct-IMat-GGUF/tree/main/Qwen2.5-72B-Instruct.Q6_K) | Q6_K | 64.35GB | β
Available | βͺ Static | β Yes
|
64 |
| [Qwen2.5-72B-Instruct.Q4_K/*](https://huggingface.co/legraphista/Qwen2.5-72B-Instruct-IMat-GGUF/tree/main/Qwen2.5-72B-Instruct.Q4_K) | Q4_K | 47.42GB | β
Available | π’ IMatrix | β Yes
|
65 |
| [Qwen2.5-72B-Instruct.Q3_K.gguf](https://huggingface.co/legraphista/Qwen2.5-72B-Instruct-IMat-GGUF/blob/main/Qwen2.5-72B-Instruct.Q3_K.gguf) | Q3_K | 37.70GB | β
Available | π’ IMatrix | π¦ No
|
66 |
-
| Qwen2.5-72B-Instruct.Q2_K | Q2_K |
|
67 |
|
68 |
|
69 |
### All Quants
|
@@ -86,7 +86,7 @@ Link: [here](https://huggingface.co/legraphista/Qwen2.5-72B-Instruct-IMat-GGUF/b
|
|
86 |
| Qwen2.5-72B-Instruct.IQ3_S | IQ3_S | - | β³ Processing | π’ IMatrix | -
|
87 |
| Qwen2.5-72B-Instruct.IQ3_XS | IQ3_XS | - | β³ Processing | π’ IMatrix | -
|
88 |
| Qwen2.5-72B-Instruct.IQ3_XXS | IQ3_XXS | - | β³ Processing | π’ IMatrix | -
|
89 |
-
| Qwen2.5-72B-Instruct.Q2_K | Q2_K |
|
90 |
| Qwen2.5-72B-Instruct.Q2_K_S | Q2_K_S | - | β³ Processing | π’ IMatrix | -
|
91 |
| Qwen2.5-72B-Instruct.IQ2_M | IQ2_M | - | β³ Processing | π’ IMatrix | -
|
92 |
| Qwen2.5-72B-Instruct.IQ2_S | IQ2_S | - | β³ Processing | π’ IMatrix | -
|
|
|
63 |
| [Qwen2.5-72B-Instruct.Q6_K/*](https://huggingface.co/legraphista/Qwen2.5-72B-Instruct-IMat-GGUF/tree/main/Qwen2.5-72B-Instruct.Q6_K) | Q6_K | 64.35GB | β
Available | βͺ Static | β Yes
|
64 |
| [Qwen2.5-72B-Instruct.Q4_K/*](https://huggingface.co/legraphista/Qwen2.5-72B-Instruct-IMat-GGUF/tree/main/Qwen2.5-72B-Instruct.Q4_K) | Q4_K | 47.42GB | β
Available | π’ IMatrix | β Yes
|
65 |
| [Qwen2.5-72B-Instruct.Q3_K.gguf](https://huggingface.co/legraphista/Qwen2.5-72B-Instruct-IMat-GGUF/blob/main/Qwen2.5-72B-Instruct.Q3_K.gguf) | Q3_K | 37.70GB | β
Available | π’ IMatrix | π¦ No
|
66 |
+
| [Qwen2.5-72B-Instruct.Q2_K.gguf](https://huggingface.co/legraphista/Qwen2.5-72B-Instruct-IMat-GGUF/blob/main/Qwen2.5-72B-Instruct.Q2_K.gguf) | Q2_K | 29.81GB | β
Available | π’ IMatrix | π¦ No
|
67 |
|
68 |
|
69 |
### All Quants
|
|
|
86 |
| Qwen2.5-72B-Instruct.IQ3_S | IQ3_S | - | β³ Processing | π’ IMatrix | -
|
87 |
| Qwen2.5-72B-Instruct.IQ3_XS | IQ3_XS | - | β³ Processing | π’ IMatrix | -
|
88 |
| Qwen2.5-72B-Instruct.IQ3_XXS | IQ3_XXS | - | β³ Processing | π’ IMatrix | -
|
89 |
+
| [Qwen2.5-72B-Instruct.Q2_K.gguf](https://huggingface.co/legraphista/Qwen2.5-72B-Instruct-IMat-GGUF/blob/main/Qwen2.5-72B-Instruct.Q2_K.gguf) | Q2_K | 29.81GB | β
Available | π’ IMatrix | π¦ No
|
90 |
| Qwen2.5-72B-Instruct.Q2_K_S | Q2_K_S | - | β³ Processing | π’ IMatrix | -
|
91 |
| Qwen2.5-72B-Instruct.IQ2_M | IQ2_M | - | β³ Processing | π’ IMatrix | -
|
92 |
| Qwen2.5-72B-Instruct.IQ2_S | IQ2_S | - | β³ Processing | π’ IMatrix | -
|