Update README.md
Browse files
README.md
CHANGED
@@ -51,7 +51,7 @@ File `medalpaca-13B-GPTQ-4bit-128g.no-act-order.safetensors` can be loaded the s
|
|
51 |
|
52 |
The other `safetensors` model file was created with the latest GPTQ code, and uses `--act-order` to give the maximum possible quantisation quality, but this means it requires that the latest GPTQ-for-LLaMa is used inside the UI.
|
53 |
|
54 |
-
If you want to use the `safetensors` file and need to update GPTQ-for-LLaMa, here are the commands I used to clone the Triton branch of GPTQ-for-LLaMa, clone text-generation-webui, and install GPTQ into the UI:
|
55 |
```
|
56 |
# Clone text-generation-webui, if you don't already have it
|
57 |
git clone https://github.com/oobabooga/text-generation-webui
|
|
|
51 |
|
52 |
The other `safetensors` model file was created with the latest GPTQ code, and uses `--act-order` to give the maximum possible quantisation quality, but this means it requires that the latest GPTQ-for-LLaMa is used inside the UI.
|
53 |
|
54 |
+
If you want to use the act-order `safetensors` file and need to update GPTQ-for-LLaMa, here are the commands I used to clone the Triton branch of GPTQ-for-LLaMa, clone text-generation-webui, and install GPTQ into the UI:
|
55 |
```
|
56 |
# Clone text-generation-webui, if you don't already have it
|
57 |
git clone https://github.com/oobabooga/text-generation-webui
|