TheBloke commited on
Commit
3d66a9f
1 Parent(s): a84714c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -51,7 +51,7 @@ File `medalpaca-13B-GPTQ-4bit-128g.no-act-order.safetensors` can be loaded the s
51
 
52
  The other `safetensors` model file was created with the latest GPTQ code, and uses `--act-order` to give the maximum possible quantisation quality, but this means it requires that the latest GPTQ-for-LLaMa is used inside the UI.
53
 
54
- If you want to use the `safetensors` file and need to update GPTQ-for-LLaMa, here are the commands I used to clone the Triton branch of GPTQ-for-LLaMa, clone text-generation-webui, and install GPTQ into the UI:
55
  ```
56
  # Clone text-generation-webui, if you don't already have it
57
  git clone https://github.com/oobabooga/text-generation-webui
 
51
 
52
  The other `safetensors` model file was created with the latest GPTQ code, and uses `--act-order` to give the maximum possible quantisation quality, but this means it requires that the latest GPTQ-for-LLaMa is used inside the UI.
53
 
54
+ If you want to use the act-order `safetensors` file and need to update GPTQ-for-LLaMa, here are the commands I used to clone the Triton branch of GPTQ-for-LLaMa, clone text-generation-webui, and install GPTQ into the UI:
55
  ```
56
  # Clone text-generation-webui, if you don't already have it
57
  git clone https://github.com/oobabooga/text-generation-webui