Update README.md
Browse files
README.md
CHANGED
@@ -21,11 +21,7 @@ The dataset used to fine-tune this model is available [here](https://huggingface
|
|
21 |
|
22 |
This model was fine-tuned with a fork of FastChat, and therefore uses the standard vicuna template:
|
23 |
```
|
24 |
-
USER:
|
25 |
-
[prompt]
|
26 |
-
|
27 |
-
</s>
|
28 |
-
ASSISTANT:
|
29 |
```
|
30 |
|
31 |
The most important bit, to me, is the context obedient question answering support, without extensive prompt engineering.
|
@@ -68,6 +64,8 @@ BEGININSTRUCTION
|
|
68 |
ENDINSTRUCTION
|
69 |
```
|
70 |
|
|
|
|
|
71 |
*The __only__ prompts that need this closed context formating are closed-context instructions. Normal questions/instructions do not!*
|
72 |
|
73 |
I know it's a bit verbose and annoying, but after much trial and error, using these explicit delimiters helps the model understand where to find the responses and how to associate specific sources with it.
|
@@ -105,11 +103,10 @@ date: 2021-01-01
|
|
105 |
url: https://web.site/123
|
106 |
```
|
107 |
|
108 |
-
The prompt itself should
|
109 |
|
110 |
```
|
111 |
-
USER:
|
112 |
-
BEGININPUT
|
113 |
BEGINCONTEXT
|
114 |
date: 2021-01-01
|
115 |
url: https://web.site/123
|
@@ -119,9 +116,7 @@ ENDINPUT
|
|
119 |
BEGININSTRUCTION
|
120 |
What color are bluberries? Source?
|
121 |
ENDINSTRUCTION
|
122 |
-
|
123 |
-
|
124 |
-
ASSISTANT:
|
125 |
```
|
126 |
|
127 |
<details>
|
|
|
21 |
|
22 |
This model was fine-tuned with a fork of FastChat, and therefore uses the standard vicuna template:
|
23 |
```
|
24 |
+
USER: [prompt] ASSISTANT:
|
|
|
|
|
|
|
|
|
25 |
```
|
26 |
|
27 |
The most important bit, to me, is the context obedient question answering support, without extensive prompt engineering.
|
|
|
64 |
ENDINSTRUCTION
|
65 |
```
|
66 |
|
67 |
+
It's also helpful to add "Don't make up answers if you don't know." to your instruction block to make sure if the context is completely unrelated it doesn't make something up.
|
68 |
+
|
69 |
*The __only__ prompts that need this closed context formating are closed-context instructions. Normal questions/instructions do not!*
|
70 |
|
71 |
I know it's a bit verbose and annoying, but after much trial and error, using these explicit delimiters helps the model understand where to find the responses and how to associate specific sources with it.
|
|
|
103 |
url: https://web.site/123
|
104 |
```
|
105 |
|
106 |
+
The prompt itself should be wrapped in the vicuna1.1 template if you aren't using fastchat with the conv-template vicuna_v1.1 as described:
|
107 |
|
108 |
```
|
109 |
+
USER: BEGININPUT
|
|
|
110 |
BEGINCONTEXT
|
111 |
date: 2021-01-01
|
112 |
url: https://web.site/123
|
|
|
116 |
BEGININSTRUCTION
|
117 |
What color are bluberries? Source?
|
118 |
ENDINSTRUCTION
|
119 |
+
ASSISTANT:
|
|
|
|
|
120 |
```
|
121 |
|
122 |
<details>
|