Update README.md
Browse files
README.md
CHANGED
@@ -18,11 +18,9 @@ Please read the Provided Files section below. You should use `medalpaca-13B-GPTQ
|
|
18 |
|
19 |
## Provided files
|
20 |
|
21 |
-
Two files are provided.
|
22 |
|
23 |
-
|
24 |
-
|
25 |
-
Specifically, the file that uses act-order it will not work with oobabooga's fork of GPTQ-for-LLaMa and therefore it will not work with `text-generation-webui` one-click installers.
|
26 |
|
27 |
Unless you are able to use the latest GPTQ-for-LLaMa code, please use `medalpaca-13B-GPTQ-4bit-128g.no-act-order.safetensors`
|
28 |
|
|
|
18 |
|
19 |
## Provided files
|
20 |
|
21 |
+
Two files are provided. **The second file will not work unless you use recent GPTQ-for-LLaMa code**
|
22 |
|
23 |
+
Specifically, the second file uses `--act-order` for maximum quantisation quality and will not work with oobabooga's fork of GPTQ-for-LLaMa. Therefore at this time it will also not work with `text-generation-webui` one-click installers.
|
|
|
|
|
24 |
|
25 |
Unless you are able to use the latest GPTQ-for-LLaMa code, please use `medalpaca-13B-GPTQ-4bit-128g.no-act-order.safetensors`
|
26 |
|