Commit
•
2b0c121
1
Parent(s):
37a0b4e
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -82,6 +82,9 @@ tags:
|
|
| 82 |
| [Qwen1.5-110B-Chat-Q4_K_M-00003-of-00003.gguf](https://huggingface.co/second-state/Qwen1.5-110B-Chat-GGUF/blob/main/Qwen1.5-110B-Chat-Q4_K_M-00003-of-00003.gguf) | Q4_K_M | 4 | 3.09 GB| medium, balanced quality - recommended |
|
| 83 |
| [Qwen1.5-110B-Chat-Q4_K_S-00001-of-00002.gguf](https://huggingface.co/second-state/Qwen1.5-110B-Chat-GGUF/blob/main/Qwen1.5-110B-Chat-Q4_K_S-00001-of-00002.gguf) | Q4_K_S | 4 | 32.1 GB| small, greater quality loss |
|
| 84 |
| [Qwen1.5-110B-Chat-Q4_K_S-00002-of-00002.gguf](https://huggingface.co/second-state/Qwen1.5-110B-Chat-GGUF/blob/main/Qwen1.5-110B-Chat-Q4_K_S-00002-of-00002.gguf) | Q4_K_S | 4 | 31.3 GB| small, greater quality loss |
|
|
|
|
|
|
|
|
|
|
| 85 |
| [Qwen1.5-110B-Chat-Q5_K_M-00001-of-00003.gguf](https://huggingface.co/second-state/Qwen1.5-110B-Chat-GGUF/blob/main/Qwen1.5-110B-Chat-Q5_K_M-00001-of-00003.gguf) | Q5_K_M | 5 | 32.1 GB| large, very low quality loss - recommended |
|
| 86 |
| [Qwen1.5-110B-Chat-Q5_K_M-00002-of-00003.gguf](https://huggingface.co/second-state/Qwen1.5-110B-Chat-GGUF/blob/main/Qwen1.5-110B-Chat-Q5_K_M-00002-of-00003.gguf) | Q5_K_M | 5 | 32 GB| large, very low quality loss - recommended |
|
| 87 |
| [Qwen1.5-110B-Chat-Q5_K_M-00003-of-00003.gguf](https://huggingface.co/second-state/Qwen1.5-110B-Chat-GGUF/blob/main/Qwen1.5-110B-Chat-Q5_K_M-00003-of-00003.gguf) | Q5_K_M | 5 | 14.8 GB| large, very low quality loss - recommended |
|
|
|
|
| 82 |
| [Qwen1.5-110B-Chat-Q4_K_M-00003-of-00003.gguf](https://huggingface.co/second-state/Qwen1.5-110B-Chat-GGUF/blob/main/Qwen1.5-110B-Chat-Q4_K_M-00003-of-00003.gguf) | Q4_K_M | 4 | 3.09 GB| medium, balanced quality - recommended |
|
| 83 |
| [Qwen1.5-110B-Chat-Q4_K_S-00001-of-00002.gguf](https://huggingface.co/second-state/Qwen1.5-110B-Chat-GGUF/blob/main/Qwen1.5-110B-Chat-Q4_K_S-00001-of-00002.gguf) | Q4_K_S | 4 | 32.1 GB| small, greater quality loss |
|
| 84 |
| [Qwen1.5-110B-Chat-Q4_K_S-00002-of-00002.gguf](https://huggingface.co/second-state/Qwen1.5-110B-Chat-GGUF/blob/main/Qwen1.5-110B-Chat-Q4_K_S-00002-of-00002.gguf) | Q4_K_S | 4 | 31.3 GB| small, greater quality loss |
|
| 85 |
+
| [Qwen1.5-110B-Chat-Q5_0-00001-of-00003.gguf](https://huggingface.co/second-state/Qwen1.5-110B-Chat-GGUF/blob/main/Qwen1.5-110B-Chat-Q5_0-00001-of-00003.gguf) | Q5_0 | 5 | 32 GB| legacy; medium, balanced quality - prefer using Q4_K_M |
|
| 86 |
+
| [Qwen1.5-110B-Chat-Q5_0-00002-of-00003.gguf](https://huggingface.co/second-state/Qwen1.5-110B-Chat-GGUF/blob/main/Qwen1.5-110B-Chat-Q5_0-00002-of-00003.gguf) | Q5_0 | 5 | 32.1 GB| legacy; medium, balanced quality - prefer using Q4_K_M |
|
| 87 |
+
| [Qwen1.5-110B-Chat-Q5_0-00003-of-00003.gguf](https://huggingface.co/second-state/Qwen1.5-110B-Chat-GGUF/blob/main/Qwen1.5-110B-Chat-Q5_0-00003-of-00003.gguf) | Q5_0 | 5 | 12.5 GB| legacy; medium, balanced quality - prefer using Q4_K_M |
|
| 88 |
| [Qwen1.5-110B-Chat-Q5_K_M-00001-of-00003.gguf](https://huggingface.co/second-state/Qwen1.5-110B-Chat-GGUF/blob/main/Qwen1.5-110B-Chat-Q5_K_M-00001-of-00003.gguf) | Q5_K_M | 5 | 32.1 GB| large, very low quality loss - recommended |
|
| 89 |
| [Qwen1.5-110B-Chat-Q5_K_M-00002-of-00003.gguf](https://huggingface.co/second-state/Qwen1.5-110B-Chat-GGUF/blob/main/Qwen1.5-110B-Chat-Q5_K_M-00002-of-00003.gguf) | Q5_K_M | 5 | 32 GB| large, very low quality loss - recommended |
|
| 90 |
| [Qwen1.5-110B-Chat-Q5_K_M-00003-of-00003.gguf](https://huggingface.co/second-state/Qwen1.5-110B-Chat-GGUF/blob/main/Qwen1.5-110B-Chat-Q5_K_M-00003-of-00003.gguf) | Q5_K_M | 5 | 14.8 GB| large, very low quality loss - recommended |
|