legraphista
commited on
Commit
β’
7b3257e
1
Parent(s):
614d216
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
@@ -52,7 +52,7 @@ IMatrix dataset: [here](https://gist.githubusercontent.com/bartowski1182/eb213dc
|
|
52 |
## Files
|
53 |
|
54 |
### IMatrix
|
55 |
-
Status:
|
56 |
Link: [here](https://huggingface.co/legraphista/Qwen2-0.5B-IMat-GGUF/blob/main/imatrix.dat)
|
57 |
|
58 |
### Common Quants
|
@@ -69,7 +69,7 @@ Link: [here](https://huggingface.co/legraphista/Qwen2-0.5B-IMat-GGUF/blob/main/i
|
|
69 |
| Filename | Quant type | File Size | Status | Uses IMatrix | Is Split |
|
70 |
| -------- | ---------- | --------- | ------ | ------------ | -------- |
|
71 |
| [Qwen2-0.5B.BF16.gguf](https://huggingface.co/legraphista/Qwen2-0.5B-IMat-GGUF/blob/main/Qwen2-0.5B.BF16.gguf) | BF16 | 994.15MB | β
Available | βͺ Static | π¦ No
|
72 |
-
| Qwen2-0.5B.FP16 | F16 |
|
73 |
| [Qwen2-0.5B.Q8_0.gguf](https://huggingface.co/legraphista/Qwen2-0.5B-IMat-GGUF/blob/main/Qwen2-0.5B.Q8_0.gguf) | Q8_0 | 531.07MB | β
Available | βͺ Static | π¦ No
|
74 |
| [Qwen2-0.5B.Q6_K.gguf](https://huggingface.co/legraphista/Qwen2-0.5B-IMat-GGUF/blob/main/Qwen2-0.5B.Q6_K.gguf) | Q6_K | 505.73MB | β
Available | βͺ Static | π¦ No
|
75 |
| Qwen2-0.5B.Q5_K | Q5_K | - | β³ Processing | βͺ Static | -
|
|
|
52 |
## Files
|
53 |
|
54 |
### IMatrix
|
55 |
+
Status: β
Available
|
56 |
Link: [here](https://huggingface.co/legraphista/Qwen2-0.5B-IMat-GGUF/blob/main/imatrix.dat)
|
57 |
|
58 |
### Common Quants
|
|
|
69 |
| Filename | Quant type | File Size | Status | Uses IMatrix | Is Split |
|
70 |
| -------- | ---------- | --------- | ------ | ------------ | -------- |
|
71 |
| [Qwen2-0.5B.BF16.gguf](https://huggingface.co/legraphista/Qwen2-0.5B-IMat-GGUF/blob/main/Qwen2-0.5B.BF16.gguf) | BF16 | 994.15MB | β
Available | βͺ Static | π¦ No
|
72 |
+
| [Qwen2-0.5B.FP16.gguf](https://huggingface.co/legraphista/Qwen2-0.5B-IMat-GGUF/blob/main/Qwen2-0.5B.FP16.gguf) | F16 | 994.15MB | β
Available | βͺ Static | π¦ No
|
73 |
| [Qwen2-0.5B.Q8_0.gguf](https://huggingface.co/legraphista/Qwen2-0.5B-IMat-GGUF/blob/main/Qwen2-0.5B.Q8_0.gguf) | Q8_0 | 531.07MB | β
Available | βͺ Static | π¦ No
|
74 |
| [Qwen2-0.5B.Q6_K.gguf](https://huggingface.co/legraphista/Qwen2-0.5B-IMat-GGUF/blob/main/Qwen2-0.5B.Q6_K.gguf) | Q6_K | 505.73MB | β
Available | βͺ Static | π¦ No
|
75 |
| Qwen2-0.5B.Q5_K | Q5_K | - | β³ Processing | βͺ Static | -
|