TheBloke
/

falcon-40b-instruct-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

TheBloke commited on Jun 22, 2023

Commit

6100143

•

1 Parent(s): e1ef23d

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -88,7 +88,7 @@ So please first update text-genration-webui to the latest version.
 8. In the **Model drop-down**: choose the model you just downloaded, `falcon-40B-instruct-GPTQ`.
 9. Make sure **Loader** is set to **AutoGPTQ**. This model will not work with ExLlama or GPTQ-for-LLaMa.
 10. Tick **Trust Remote Code**, followed by **Save Settings**
-11. Make sure Click **Reload**.
 12. Once it says it's loaded, click the **Text Generation tab** and enter a prompt!
 ## About `trust_remote_code`

 8. In the **Model drop-down**: choose the model you just downloaded, `falcon-40B-instruct-GPTQ`.
 9. Make sure **Loader** is set to **AutoGPTQ**. This model will not work with ExLlama or GPTQ-for-LLaMa.
 10. Tick **Trust Remote Code**, followed by **Save Settings**
+11. Click **Reload**.
 12. Once it says it's loaded, click the **Text Generation tab** and enter a prompt!
 ## About `trust_remote_code`