legraphista
commited on
Commit
β’
2031b06
1
Parent(s):
9696348
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
@@ -46,7 +46,7 @@ Link: [here](https://huggingface.co/legraphista/Mistral-7B-v0.3-IMat-GGUF/blob/m
|
|
46 |
### Common Quants
|
47 |
| Filename | Quant type | File Size | Status | Uses IMatrix | Is Split |
|
48 |
| -------- | ---------- | --------- | ------ | ------------ | -------- |
|
49 |
-
| Mistral-7B-v0.3.Q8_0 | Q8_0 |
|
50 |
| [Mistral-7B-v0.3.Q6_K.gguf](https://huggingface.co/legraphista/Mistral-7B-v0.3-IMat-GGUF/blob/main/Mistral-7B-v0.3.Q6_K.gguf) | Q6_K | 5.95GB | β
Available | βͺ No | π¦ No
|
51 |
| Mistral-7B-v0.3.Q4_K | Q4_K | - | β³ Processing | π’ Yes | -
|
52 |
| Mistral-7B-v0.3.Q3_K | Q3_K | - | β³ Processing | π’ Yes | -
|
|
|
46 |
### Common Quants
|
47 |
| Filename | Quant type | File Size | Status | Uses IMatrix | Is Split |
|
48 |
| -------- | ---------- | --------- | ------ | ------------ | -------- |
|
49 |
+
| [Mistral-7B-v0.3.Q8_0.gguf](https://huggingface.co/legraphista/Mistral-7B-v0.3-IMat-GGUF/blob/main/Mistral-7B-v0.3.Q8_0.gguf) | Q8_0 | 7.70GB | β
Available | βͺ No | π¦ No
|
50 |
| [Mistral-7B-v0.3.Q6_K.gguf](https://huggingface.co/legraphista/Mistral-7B-v0.3-IMat-GGUF/blob/main/Mistral-7B-v0.3.Q6_K.gguf) | Q6_K | 5.95GB | β
Available | βͺ No | π¦ No
|
51 |
| Mistral-7B-v0.3.Q4_K | Q4_K | - | β³ Processing | π’ Yes | -
|
52 |
| Mistral-7B-v0.3.Q3_K | Q3_K | - | β³ Processing | π’ Yes | -
|