TheBloke commited on
Commit
7aeb8db
1 Parent(s): c0c48c8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -9
README.md CHANGED
@@ -37,19 +37,18 @@ It is the result of quantising to 4bit using [GPTQ-for-LLaMa](https://github.com
37
 
38
  ## How to easily download and use this model in text-generation-webui
39
 
40
- Open the text-generation-webui UI as normal.
41
 
42
  1. Click the **Model tab**.
43
  2. Under **Download custom model or LoRA**, enter `TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ`.
44
  3. Click **Download**.
45
- 4. Wait until it says it's finished downloading.
46
- 5. Click the **Refresh** icon next to **Model** in the top left.
47
- 6. In the **Model drop-down**: choose the model you just downloaded, `Wizard-Vicuna-30B-Uncensored-GPTQ`.
48
- 7. If you see an error in the bottom right, ignore it - it's temporary.
49
- 8. Fill out the `GPTQ parameters` on the right: `Bits = 4`, `Groupsize = None`, `model_type = Llama`
50
- 9. Click **Save settings for this model** in the top right.
51
- 10. Click **Reload the Model** in the top right.
52
- 11. Once it says it's loaded, click the **Text Generation tab** and enter a prompt!
53
 
54
  ## Provided files
55
 
 
37
 
38
  ## How to easily download and use this model in text-generation-webui
39
 
40
+ Please make sure you're using the latest version of text-generation-webui
41
 
42
  1. Click the **Model tab**.
43
  2. Under **Download custom model or LoRA**, enter `TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ`.
44
  3. Click **Download**.
45
+ 4. The model will start downloading. Once it's finished it will say "Done"
46
+ 5. In the top left, click the refresh icon next to **Model**.
47
+ 6. In the **Model** dropdown, choose the model you just downloaded: `Wizard-Vicuna-30B-Uncensored-GPTQ`
48
+ 7. The model will automatically load, and is now ready for use!
49
+ 8. If you want any custom settings, set them and then click **Save settings for this model** followed by **Reload the Model** in the top right.
50
+ * Note that you do not need to set GPTQ parameters any more. These should all be set to default values, as they are now set automatically from the file `quantize_config.json`.
51
+ 9. Once you're ready, click the **Text Generation tab** and enter a prompt to get started!
 
52
 
53
  ## Provided files
54