jondurbin commited on
Commit
22e23f4
1 Parent(s): 65fb081

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -11
README.md CHANGED
@@ -21,11 +21,7 @@ The dataset used to fine-tune this model is available [here](https://huggingface
21
 
22
  This model was fine-tuned with a fork of FastChat, and therefore uses the standard vicuna template:
23
  ```
24
- USER:
25
- [prompt]
26
-
27
- </s>
28
- ASSISTANT:
29
  ```
30
 
31
  The most important bit, to me, is the context obedient question answering support, without extensive prompt engineering.
@@ -68,6 +64,8 @@ BEGININSTRUCTION
68
  ENDINSTRUCTION
69
  ```
70
 
 
 
71
  *The __only__ prompts that need this closed context formating are closed-context instructions. Normal questions/instructions do not!*
72
 
73
  I know it's a bit verbose and annoying, but after much trial and error, using these explicit delimiters helps the model understand where to find the responses and how to associate specific sources with it.
@@ -105,11 +103,10 @@ date: 2021-01-01
105
  url: https://web.site/123
106
  ```
107
 
108
- The prompt itself should can be wrapped in the vicuna1.1 template if you aren't using fastchat with the conv-template vicuna_v1.1 as described (although it seems to understand without it as well, so :shrug:). For example, the above prompt, as a standalone, would be:
109
 
110
  ```
111
- USER:
112
- BEGININPUT
113
  BEGINCONTEXT
114
  date: 2021-01-01
115
  url: https://web.site/123
@@ -119,9 +116,7 @@ ENDINPUT
119
  BEGININSTRUCTION
120
  What color are bluberries? Source?
121
  ENDINSTRUCTION
122
- </s>
123
-
124
- ASSISTANT:
125
  ```
126
 
127
  <details>
 
21
 
22
  This model was fine-tuned with a fork of FastChat, and therefore uses the standard vicuna template:
23
  ```
24
+ USER: [prompt] ASSISTANT:
 
 
 
 
25
  ```
26
 
27
  The most important bit, to me, is the context obedient question answering support, without extensive prompt engineering.
 
64
  ENDINSTRUCTION
65
  ```
66
 
67
+ It's also helpful to add "Don't make up answers if you don't know." to your instruction block to make sure if the context is completely unrelated it doesn't make something up.
68
+
69
  *The __only__ prompts that need this closed context formating are closed-context instructions. Normal questions/instructions do not!*
70
 
71
  I know it's a bit verbose and annoying, but after much trial and error, using these explicit delimiters helps the model understand where to find the responses and how to associate specific sources with it.
 
103
  url: https://web.site/123
104
  ```
105
 
106
+ The prompt itself should be wrapped in the vicuna1.1 template if you aren't using fastchat with the conv-template vicuna_v1.1 as described:
107
 
108
  ```
109
+ USER: BEGININPUT
 
110
  BEGINCONTEXT
111
  date: 2021-01-01
112
  url: https://web.site/123
 
116
  BEGININSTRUCTION
117
  What color are bluberries? Source?
118
  ENDINSTRUCTION
119
+ ASSISTANT:
 
 
120
  ```
121
 
122
  <details>