Update README.md
Browse files
README.md
CHANGED
@@ -29,6 +29,15 @@ It is the result of quantising to 4bit using [GPTQ-for-LLaMa](https://github.com
|
|
29 |
* [2, 3, 4, 5, 6 and 8-bit GGML models for CPU+GPU inference](https://huggingface.co/TheBloke/WizardLM-7B-V1.0-Uncensored-GGML)
|
30 |
* [Unquantised fp16 model in pytorch format, for GPU inference and for further conversions](https://huggingface.co/ehartford/WizardLM-7B-V1.0-Uncensored)
|
31 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
32 |
## How to easily download and use this model in text-generation-webui
|
33 |
|
34 |
Please make sure you're using the latest version of text-generation-webui
|
@@ -74,8 +83,8 @@ model = AutoGPTQForCausalLM.from_quantized(model_name_or_path,
|
|
74 |
|
75 |
# Note: check the prompt template is correct for this model.
|
76 |
prompt = "Tell me about AI"
|
77 |
-
prompt_template=f'''
|
78 |
-
|
79 |
|
80 |
print("\n\n*** Generate:")
|
81 |
|
|
|
29 |
* [2, 3, 4, 5, 6 and 8-bit GGML models for CPU+GPU inference](https://huggingface.co/TheBloke/WizardLM-7B-V1.0-Uncensored-GGML)
|
30 |
* [Unquantised fp16 model in pytorch format, for GPU inference and for further conversions](https://huggingface.co/ehartford/WizardLM-7B-V1.0-Uncensored)
|
31 |
|
32 |
+
## Prompt template
|
33 |
+
|
34 |
+
```
|
35 |
+
You are a helpful AI assistant.
|
36 |
+
|
37 |
+
USER: <prompt>
|
38 |
+
ASSISTANT:
|
39 |
+
```
|
40 |
+
|
41 |
## How to easily download and use this model in text-generation-webui
|
42 |
|
43 |
Please make sure you're using the latest version of text-generation-webui
|
|
|
83 |
|
84 |
# Note: check the prompt template is correct for this model.
|
85 |
prompt = "Tell me about AI"
|
86 |
+
prompt_template=f'''USER: {prompt}
|
87 |
+
ASSISTANT:'''
|
88 |
|
89 |
print("\n\n*** Generate:")
|
90 |
|