TheBloke commited on
Commit
e1ef23d
1 Parent(s): df10d83

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +11 -7
README.md CHANGED
@@ -78,14 +78,18 @@ So please first update text-genration-webui to the latest version.
78
 
79
  ## How to download and use this model in text-generation-webui
80
 
81
- 1. Launch text-generation-webui with the following command-line arguments: `--autogptq --trust-remote-code`
82
  2. Click the **Model tab**.
83
- 3. Under **Download custom model or LoRA**, enter `TheBloke/falcon-40B-instruct-GPTQ`.
84
- 4. Click **Download**.
85
- 5. Wait until it says it's finished downloading.
86
- 6. Click the **Refresh** icon next to **Model** in the top left.
87
- 7. In the **Model drop-down**: choose the model you just downloaded, `falcon-40B-instruct-GPTQ`.
88
- 8. Once it says it's loaded, click the **Text Generation tab** and enter a prompt!
 
 
 
 
89
 
90
  ## About `trust_remote_code`
91
 
 
78
 
79
  ## How to download and use this model in text-generation-webui
80
 
81
+ 1. Launch text-generation-webui
82
  2. Click the **Model tab**.
83
+ 3. Untick **Autoload model**
84
+ 4. Under **Download custom model or LoRA**, enter `TheBloke/falcon-40B-instruct-GPTQ`.
85
+ 5. Click **Download**.
86
+ 6. Wait until it says it's finished downloading.
87
+ 7. Click the **Refresh** icon next to **Model** in the top left.
88
+ 8. In the **Model drop-down**: choose the model you just downloaded, `falcon-40B-instruct-GPTQ`.
89
+ 9. Make sure **Loader** is set to **AutoGPTQ**. This model will not work with ExLlama or GPTQ-for-LLaMa.
90
+ 10. Tick **Trust Remote Code**, followed by **Save Settings**
91
+ 11. Make sure Click **Reload**.
92
+ 12. Once it says it's loaded, click the **Text Generation tab** and enter a prompt!
93
 
94
  ## About `trust_remote_code`
95