Commit
β’
0f95786
1
Parent(s):
cbc0702
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
@@ -66,7 +66,7 @@ Link: [here](https://huggingface.co/legraphista/dolphin-2.9.1-mixtral-1x22b-IMat
|
|
66 |
| Filename | Quant type | File Size | Status | Uses IMatrix | Is Split |
|
67 |
| -------- | ---------- | --------- | ------ | ------------ | -------- |
|
68 |
| [dolphin-2.9.1-mixtral-1x22b.Q8_0.gguf](https://huggingface.co/legraphista/dolphin-2.9.1-mixtral-1x22b-IMat-GGUF/blob/main/dolphin-2.9.1-mixtral-1x22b.Q8_0.gguf) | Q8_0 | 23.63GB | β
Available | βͺ Static | π¦ No
|
69 |
-
| dolphin-2.9.1-mixtral-1x22b.Q6_K | Q6_K |
|
70 |
| dolphin-2.9.1-mixtral-1x22b.Q4_K | Q4_K | - | β³ Processing | π’ IMatrix | -
|
71 |
| dolphin-2.9.1-mixtral-1x22b.Q3_K | Q3_K | - | β³ Processing | π’ IMatrix | -
|
72 |
| dolphin-2.9.1-mixtral-1x22b.Q2_K | Q2_K | - | β³ Processing | π’ IMatrix | -
|
@@ -78,7 +78,7 @@ Link: [here](https://huggingface.co/legraphista/dolphin-2.9.1-mixtral-1x22b-IMat
|
|
78 |
| [dolphin-2.9.1-mixtral-1x22b.BF16.gguf](https://huggingface.co/legraphista/dolphin-2.9.1-mixtral-1x22b-IMat-GGUF/blob/main/dolphin-2.9.1-mixtral-1x22b.BF16.gguf) | BF16 | 44.48GB | β
Available | βͺ Static | π¦ No
|
79 |
| [dolphin-2.9.1-mixtral-1x22b.FP16.gguf](https://huggingface.co/legraphista/dolphin-2.9.1-mixtral-1x22b-IMat-GGUF/blob/main/dolphin-2.9.1-mixtral-1x22b.FP16.gguf) | F16 | 44.48GB | β
Available | βͺ Static | π¦ No
|
80 |
| [dolphin-2.9.1-mixtral-1x22b.Q8_0.gguf](https://huggingface.co/legraphista/dolphin-2.9.1-mixtral-1x22b-IMat-GGUF/blob/main/dolphin-2.9.1-mixtral-1x22b.Q8_0.gguf) | Q8_0 | 23.63GB | β
Available | βͺ Static | π¦ No
|
81 |
-
| dolphin-2.9.1-mixtral-1x22b.Q6_K | Q6_K |
|
82 |
| [dolphin-2.9.1-mixtral-1x22b.Q5_K.gguf](https://huggingface.co/legraphista/dolphin-2.9.1-mixtral-1x22b-IMat-GGUF/blob/main/dolphin-2.9.1-mixtral-1x22b.Q5_K.gguf) | Q5_K | 15.72GB | β
Available | βͺ Static | π¦ No
|
83 |
| [dolphin-2.9.1-mixtral-1x22b.Q5_K_S.gguf](https://huggingface.co/legraphista/dolphin-2.9.1-mixtral-1x22b-IMat-GGUF/blob/main/dolphin-2.9.1-mixtral-1x22b.Q5_K_S.gguf) | Q5_K_S | 15.32GB | β
Available | βͺ Static | π¦ No
|
84 |
| dolphin-2.9.1-mixtral-1x22b.Q4_K | Q4_K | - | β³ Processing | π’ IMatrix | -
|
|
|
66 |
| Filename | Quant type | File Size | Status | Uses IMatrix | Is Split |
|
67 |
| -------- | ---------- | --------- | ------ | ------------ | -------- |
|
68 |
| [dolphin-2.9.1-mixtral-1x22b.Q8_0.gguf](https://huggingface.co/legraphista/dolphin-2.9.1-mixtral-1x22b-IMat-GGUF/blob/main/dolphin-2.9.1-mixtral-1x22b.Q8_0.gguf) | Q8_0 | 23.63GB | β
Available | βͺ Static | π¦ No
|
69 |
+
| [dolphin-2.9.1-mixtral-1x22b.Q6_K.gguf](https://huggingface.co/legraphista/dolphin-2.9.1-mixtral-1x22b-IMat-GGUF/blob/main/dolphin-2.9.1-mixtral-1x22b.Q6_K.gguf) | Q6_K | 18.25GB | β
Available | βͺ Static | π¦ No
|
70 |
| dolphin-2.9.1-mixtral-1x22b.Q4_K | Q4_K | - | β³ Processing | π’ IMatrix | -
|
71 |
| dolphin-2.9.1-mixtral-1x22b.Q3_K | Q3_K | - | β³ Processing | π’ IMatrix | -
|
72 |
| dolphin-2.9.1-mixtral-1x22b.Q2_K | Q2_K | - | β³ Processing | π’ IMatrix | -
|
|
|
78 |
| [dolphin-2.9.1-mixtral-1x22b.BF16.gguf](https://huggingface.co/legraphista/dolphin-2.9.1-mixtral-1x22b-IMat-GGUF/blob/main/dolphin-2.9.1-mixtral-1x22b.BF16.gguf) | BF16 | 44.48GB | β
Available | βͺ Static | π¦ No
|
79 |
| [dolphin-2.9.1-mixtral-1x22b.FP16.gguf](https://huggingface.co/legraphista/dolphin-2.9.1-mixtral-1x22b-IMat-GGUF/blob/main/dolphin-2.9.1-mixtral-1x22b.FP16.gguf) | F16 | 44.48GB | β
Available | βͺ Static | π¦ No
|
80 |
| [dolphin-2.9.1-mixtral-1x22b.Q8_0.gguf](https://huggingface.co/legraphista/dolphin-2.9.1-mixtral-1x22b-IMat-GGUF/blob/main/dolphin-2.9.1-mixtral-1x22b.Q8_0.gguf) | Q8_0 | 23.63GB | β
Available | βͺ Static | π¦ No
|
81 |
+
| [dolphin-2.9.1-mixtral-1x22b.Q6_K.gguf](https://huggingface.co/legraphista/dolphin-2.9.1-mixtral-1x22b-IMat-GGUF/blob/main/dolphin-2.9.1-mixtral-1x22b.Q6_K.gguf) | Q6_K | 18.25GB | β
Available | βͺ Static | π¦ No
|
82 |
| [dolphin-2.9.1-mixtral-1x22b.Q5_K.gguf](https://huggingface.co/legraphista/dolphin-2.9.1-mixtral-1x22b-IMat-GGUF/blob/main/dolphin-2.9.1-mixtral-1x22b.Q5_K.gguf) | Q5_K | 15.72GB | β
Available | βͺ Static | π¦ No
|
83 |
| [dolphin-2.9.1-mixtral-1x22b.Q5_K_S.gguf](https://huggingface.co/legraphista/dolphin-2.9.1-mixtral-1x22b-IMat-GGUF/blob/main/dolphin-2.9.1-mixtral-1x22b.Q5_K_S.gguf) | Q5_K_S | 15.32GB | β
Available | βͺ Static | π¦ No
|
84 |
| dolphin-2.9.1-mixtral-1x22b.Q4_K | Q4_K | - | β³ Processing | π’ IMatrix | -
|