RicardoLee commited on
Commit
3e60ab8
1 Parent(s): c10861e

README rectify: Add inference template clarification

Browse files
Files changed (1) hide show
  1. README.md +18 -0
README.md CHANGED
@@ -51,6 +51,24 @@ Some details in training:
51
  5. Initial Loss: Please refer to [Material](trainer_state.json)
52
  6. Train Loss: Please refer to [Material](trainer_state.json)
53
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
54
  ## Licence
55
 
56
  本仓库的模型依照 Apache-2.0 协议开源,模型的权重的使用则需要遵循LLama2[MODEL LICENCE](LICENSE)。
 
51
  5. Initial Loss: Please refer to [Material](trainer_state.json)
52
  6. Train Loss: Please refer to [Material](trainer_state.json)
53
 
54
+ ## Inference
55
+
56
+ 该模型依然采用stanford alpaca 模版。因此在测试时且别忘记添加开场白。开场白如下:
57
+
58
+ "Below is an instruction that describes a task. Write a response that appropriately completes the request.\n\n### Instruction:\n\n${Your Content}\n\n### Response:\n\n"
59
+
60
+ 对于带上文的对话,开场白如下:
61
+
62
+ "Below is an instruction that describes a task. Write a response that appropriately completes the request.\n\n### Instruction:\n\nHuman:${Previous Human Content}\nAssistant:${Previous Assistance Content}\nHuman:${Your Question}\n\n### Response:\n\n"
63
+
64
+ This model still using the Stanford Alpaca template. Therefore, don't forget to add prologue template. The prologue template is:
65
+
66
+ "Below is an instruction that describes a task. Write a response that appropriately completes the request.\n\n### Instruction:\n\n${Your Content}\n\n### Response:\n\n"
67
+
68
+ For dialogue with context, the prelogue template is:
69
+
70
+ "Below is an instruction that describes a task. Write a response that appropriately completes the request.\n\n### Instruction:\n\nHuman:${Previous Human Content}\nAssistant:${Previous Machine Content}\nHuman:${Your Question}\n\n### Response:\n\n"
71
+
72
  ## Licence
73
 
74
  本仓库的模型依照 Apache-2.0 协议开源,模型的权重的使用则需要遵循LLama2[MODEL LICENCE](LICENSE)。