legraphista
commited on
Commit
β’
4bad5ee
1
Parent(s):
97e00a2
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
@@ -56,7 +56,7 @@ IMatrix dataset: [here](https://gist.githubusercontent.com/bartowski1182/eb213dc
|
|
56 |
### Common Quants
|
57 |
| Filename | Quant type | File Size | Status | Uses IMatrix | Is Split |
|
58 |
| -------- | ---------- | --------- | ------ | ------------ | -------- |
|
59 |
-
| glm-4-9b-chat-1m.Q8_0 | Q8_0 |
|
60 |
| [glm-4-9b-chat-1m.Q6_K.gguf](https://huggingface.co/legraphista/glm-4-9b-chat-1m-GGUF/blob/main/glm-4-9b-chat-1m.Q6_K.gguf) | Q6_K | 8.33GB | β
Available | βͺ Static | π¦ No
|
61 |
| [glm-4-9b-chat-1m.Q4_K.gguf](https://huggingface.co/legraphista/glm-4-9b-chat-1m-GGUF/blob/main/glm-4-9b-chat-1m.Q4_K.gguf) | Q4_K | 6.31GB | β
Available | βͺ Static | π¦ No
|
62 |
| glm-4-9b-chat-1m.Q3_K | Q3_K | - | β³ Processing | βͺ Static | -
|
@@ -68,7 +68,7 @@ IMatrix dataset: [here](https://gist.githubusercontent.com/bartowski1182/eb213dc
|
|
68 |
| -------- | ---------- | --------- | ------ | ------------ | -------- |
|
69 |
| glm-4-9b-chat-1m.BF16 | BF16 | - | β³ Processing | βͺ Static | -
|
70 |
| glm-4-9b-chat-1m.FP16 | F16 | - | β³ Processing | βͺ Static | -
|
71 |
-
| glm-4-9b-chat-1m.Q8_0 | Q8_0 |
|
72 |
| [glm-4-9b-chat-1m.Q6_K.gguf](https://huggingface.co/legraphista/glm-4-9b-chat-1m-GGUF/blob/main/glm-4-9b-chat-1m.Q6_K.gguf) | Q6_K | 8.33GB | β
Available | βͺ Static | π¦ No
|
73 |
| glm-4-9b-chat-1m.Q5_K | Q5_K | - | β³ Processing | βͺ Static | -
|
74 |
| glm-4-9b-chat-1m.Q5_K_S | Q5_K_S | - | β³ Processing | βͺ Static | -
|
|
|
56 |
### Common Quants
|
57 |
| Filename | Quant type | File Size | Status | Uses IMatrix | Is Split |
|
58 |
| -------- | ---------- | --------- | ------ | ------------ | -------- |
|
59 |
+
| [glm-4-9b-chat-1m.Q8_0.gguf](https://huggingface.co/legraphista/glm-4-9b-chat-1m-GGUF/blob/main/glm-4-9b-chat-1m.Q8_0.gguf) | Q8_0 | 10.08GB | β
Available | βͺ Static | π¦ No
|
60 |
| [glm-4-9b-chat-1m.Q6_K.gguf](https://huggingface.co/legraphista/glm-4-9b-chat-1m-GGUF/blob/main/glm-4-9b-chat-1m.Q6_K.gguf) | Q6_K | 8.33GB | β
Available | βͺ Static | π¦ No
|
61 |
| [glm-4-9b-chat-1m.Q4_K.gguf](https://huggingface.co/legraphista/glm-4-9b-chat-1m-GGUF/blob/main/glm-4-9b-chat-1m.Q4_K.gguf) | Q4_K | 6.31GB | β
Available | βͺ Static | π¦ No
|
62 |
| glm-4-9b-chat-1m.Q3_K | Q3_K | - | β³ Processing | βͺ Static | -
|
|
|
68 |
| -------- | ---------- | --------- | ------ | ------------ | -------- |
|
69 |
| glm-4-9b-chat-1m.BF16 | BF16 | - | β³ Processing | βͺ Static | -
|
70 |
| glm-4-9b-chat-1m.FP16 | F16 | - | β³ Processing | βͺ Static | -
|
71 |
+
| [glm-4-9b-chat-1m.Q8_0.gguf](https://huggingface.co/legraphista/glm-4-9b-chat-1m-GGUF/blob/main/glm-4-9b-chat-1m.Q8_0.gguf) | Q8_0 | 10.08GB | β
Available | βͺ Static | π¦ No
|
72 |
| [glm-4-9b-chat-1m.Q6_K.gguf](https://huggingface.co/legraphista/glm-4-9b-chat-1m-GGUF/blob/main/glm-4-9b-chat-1m.Q6_K.gguf) | Q6_K | 8.33GB | β
Available | βͺ Static | π¦ No
|
73 |
| glm-4-9b-chat-1m.Q5_K | Q5_K | - | β³ Processing | βͺ Static | -
|
74 |
| glm-4-9b-chat-1m.Q5_K_S | Q5_K_S | - | β³ Processing | βͺ Static | -
|