DeepMount00
commited on
Commit
•
0fcf93a
1
Parent(s):
0e8c943
Update README.md
Browse files
README.md
CHANGED
@@ -7,11 +7,11 @@ language:
|
|
7 |
<!-- README_GGUF.md-provided-files start -->
|
8 |
## Provided files
|
9 |
|
10 |
-
| Name | Quant method | Bits | Size
|
11 |
-
|
12 |
-
| [mistal-Ita-7b-q3_k_m.gguf](https://huggingface.co/DeepMount00/Mistral-Ita-7b-GGUF/blob/main/mistal-Ita-7b-q3_k_m.gguf) | Q3_K_M
|
13 |
-
| [mistal-Ita-7b-q4_k_m.gguf](https://huggingface.co/DeepMount00/Mistral-Ita-7b-GGUF/blob/main/mistal-Ita-7b-q4_k_m.gguf) | Q4_K_M
|
14 |
-
| [mistal-Ita-7b-q5_k_m.gguf](https://huggingface.co/DeepMount00/Mistral-Ita-7b-GGUF/blob/main/mistal-Ita-7b-q5_k_m.gguf) | Q5_K_M
|
15 |
|
16 |
**Note**: the above RAM figures assume no GPU offloading. If layers are offloaded to the GPU, this will reduce RAM usage and use VRAM instead.
|
17 |
<!-- README_GGUF.md-provided-files end -->
|
|
|
7 |
<!-- README_GGUF.md-provided-files start -->
|
8 |
## Provided files
|
9 |
|
10 |
+
| Name | Quant method | Bits | Size | Use case |
|
11 |
+
|------|--------------|------|---------|--------------------------------------------------|
|
12 |
+
| [mistal-Ita-7b-q3_k_m.gguf](https://huggingface.co/DeepMount00/Mistral-Ita-7b-GGUF/blob/main/mistal-Ita-7b-q3_k_m.gguf) | Q3_K_M | 3 | 3.52 GB | very small, high quality loss |
|
13 |
+
| [mistal-Ita-7b-q4_k_m.gguf](https://huggingface.co/DeepMount00/Mistral-Ita-7b-GGUF/blob/main/mistal-Ita-7b-q4_k_m.gguf) | Q4_K_M | 4 | 4.37 GB | medium, balanced quality - recommended |
|
14 |
+
| [mistal-Ita-7b-q5_k_m.gguf](https://huggingface.co/DeepMount00/Mistral-Ita-7b-GGUF/blob/main/mistal-Ita-7b-q5_k_m.gguf) | Q5_K_M | 5 | 7.63 GB | large, very low quality loss - recommended |
|
15 |
|
16 |
**Note**: the above RAM figures assume no GPU offloading. If layers are offloaded to the GPU, this will reduce RAM usage and use VRAM instead.
|
17 |
<!-- README_GGUF.md-provided-files end -->
|