TheBloke
/

Wizard-Vicuna-13B-Uncensored-GGML

Model card Files Files and versions Community

TheBloke commited on May 13, 2023

Commit

7dfd122

•

1 Parent(s): 50f423f

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -30,7 +30,7 @@ I have quantised the GGML files in this repo with the latest version. Therefore
 `Wizard-Vicuna-13B-Uncensored.ggml.q4_0.bin` | q4_0 | 4bit | 8.14GB | 10.5GB | 4-bit. |
 `Wizard-Vicuna-13B-Uncensored.ggml.q5_0.bin` | q5_0 | 5bit | 8.95GB | 11.0GB | 5-bit. Higher accuracy, higher resource usage and slower inference. |
 `Wizard-Vicuna-13B-Uncensored.ggml.q5_1.bin` | q5_1 | 5bit | 9.76GB | 12.25GB | 5-bit. Even higher accuracy, and higher resource usage and slower inference. |
-`Wizard-Vicuna-13B-Uncensored.ggml.q8_0.bin` | q8_0 | 8bit | 15GB | 17GB | 8-bit. Almost indistinguishable from float16. Huge resource use and slow. Not recommended for normal use. |
 ## How to run in `llama.cpp`

 `Wizard-Vicuna-13B-Uncensored.ggml.q4_0.bin` | q4_0 | 4bit | 8.14GB | 10.5GB | 4-bit. |
 `Wizard-Vicuna-13B-Uncensored.ggml.q5_0.bin` | q5_0 | 5bit | 8.95GB | 11.0GB | 5-bit. Higher accuracy, higher resource usage and slower inference. |
 `Wizard-Vicuna-13B-Uncensored.ggml.q5_1.bin` | q5_1 | 5bit | 9.76GB | 12.25GB | 5-bit. Even higher accuracy, and higher resource usage and slower inference. |
+`Wizard-Vicuna-13B-Uncensored.ggml.q8_0.bin` | q8_0 | 8bit | 14.6GB | 17GB | 8-bit. Almost indistinguishable from float16. Huge resource use and slow. Not recommended for normal use. |
 ## How to run in `llama.cpp`