Update README.md
Browse files
README.md
CHANGED
@@ -62,11 +62,11 @@ As other options become available I will endeavour to update them here (do let m
|
|
62 |
## Provided files
|
63 |
| Name | Quant method | Bits | Size | Max RAM required | Use case |
|
64 |
| ---- | ---- | ---- | ---- | ---- | ----- |
|
65 |
-
|
|
66 |
-
|
|
67 |
-
|
|
68 |
-
|
|
69 |
-
|
|
70 |
|
71 |
<!-- footer start -->
|
72 |
## Discord
|
|
|
62 |
## Provided files
|
63 |
| Name | Quant method | Bits | Size | Max RAM required | Use case |
|
64 |
| ---- | ---- | ---- | ---- | ---- | ----- |
|
65 |
+
| WizardCoder-15B-1.0.ggmlv3.q4_0.bin | q4_0 | 4 | 10.75 GB | 13.25 GB | 4-bit. |
|
66 |
+
| WizardCoder-15B-1.0.ggmlv3.q4_1.bin | q4_1 | 4 | 11.92 GB | 14.42 GB | 4-bit. Higher accuracy than q4_0 but not as high as q5_0. However has quicker inference than q5 models. |
|
67 |
+
| WizardCoder-15B-1.0.ggmlv3.q5_0.bin | q5_0 | 5 | 13.09 GB | 15.59 GB | 5-bit. Higher accuracy, higher resource usage and slower inference. |
|
68 |
+
| WizardCoder-15B-1.0.ggmlv3.q5_1.bin | q5_1 | 5 | 14.26 GB | 16.76 GB | 5-bit. Even higher accuracy, resource usage and slower inference. |
|
69 |
+
| WizardCoder-15B-1.0.ggmlv3.q8_0.bin | q8_0 | 8 | 20.11 GB | 22.61 GB | 8-bit. Almost indistinguishable from float16. High resource use and slow. Not recommended for most users. |
|
70 |
|
71 |
<!-- footer start -->
|
72 |
## Discord
|