Text Generation
PyTorch
12 languages
causal-lm
rwkv
BlinkDL commited on
Commit
54a2831
1 Parent(s): 4105e33

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +19 -2
README.md CHANGED
@@ -57,7 +57,24 @@ World v2 = 1.12T tokens
57
 
58
  Imagine what happens when we use more data :)
59
 
60
- A good chat prompt (replace \n\n in xxx to \n):
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
61
  ```
62
  User: hi
63
 
@@ -67,7 +84,7 @@ User: xxx
67
 
68
  Assistant:
69
  ```
70
- QA prompt (replace \n\n in xxx to \n):
71
  ```
72
  Question: xxx
73
 
 
57
 
58
  Imagine what happens when we use more data :)
59
 
60
+ Recommended fine-tuning format (use \n for newlines):
61
+ ```
62
+ User: xxxxxxxxxxxxxxx
63
+
64
+ Assistant: xxxxxxxxxxxxxxx
65
+ xxxxxxxxxxxxxxx
66
+ xxxxxxxxxxxxxxx
67
+
68
+ User: xxxxxxxxxxxxxxx
69
+ xxxxxxxxxxxxxxx
70
+
71
+ Assistant: xxxxxxxxxxxxxxx
72
+ xxxxxxxxxxxxxxx
73
+ xxxxxxxxxxxxxxx
74
+ xxxxxxxxxxxxxxx
75
+ ```
76
+
77
+ A good chat prompt (better replace \n\n in xxx to \n, such that there will be no newlines in xxx):
78
  ```
79
  User: hi
80
 
 
84
 
85
  Assistant:
86
  ```
87
+ QA prompt (better replace \n\n in xxx to \n, such that there will be no newlines in xxx):
88
  ```
89
  Question: xxx
90