TheBloke commited on
Commit
3e10dd5
1 Parent(s): 858f870

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -18,7 +18,7 @@ This repo contains GGML files for for CPU inference using [llama.cpp](https://gi
18
  | ---- | ---- | ---- | ---- | ---- | ----- |
19
  `WizardLM-7B.GGML.q4_0.bin` | q4_0 | 4bit | 4.0GB | 6GB | Maximum compatibility |
20
  `WizardLM-7B.GGML.q4_2.bin` | q4_2 | 4bit | 4.0GB | 6GB | Best compromise between resources, speed and quality |
21
- `WizardLM-7B.GGML.q4_3.bin` | q4_3 | 4bit | 4.8GB | 7GB | Maximum quality, high RAM requirements and slow inference |
22
 
23
  * The q4_0 file provides lower quality, but maximal compatibility. It will work with past and future versions of llama.cpp
24
  * The q4_2 file offers the best combination of performance and quality. This format is still subject to change and there may be compatibility issues, see below.
 
18
  | ---- | ---- | ---- | ---- | ---- | ----- |
19
  `WizardLM-7B.GGML.q4_0.bin` | q4_0 | 4bit | 4.0GB | 6GB | Maximum compatibility |
20
  `WizardLM-7B.GGML.q4_2.bin` | q4_2 | 4bit | 4.0GB | 6GB | Best compromise between resources, speed and quality |
21
+ `WizardLM-7B.GGML.q4_3.bin` | q4_3 | 4bit | 4.8GB | 7GB | Maximum quality, higher RAM requirements and slower inference |
22
 
23
  * The q4_0 file provides lower quality, but maximal compatibility. It will work with past and future versions of llama.cpp
24
  * The q4_2 file offers the best combination of performance and quality. This format is still subject to change and there may be compatibility issues, see below.