jartine commited on
Commit
5480707
1 Parent(s): 3e75f33

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +22 -0
README.md CHANGED
@@ -52,6 +52,28 @@ Having **trouble?** See the ["Gotchas"
52
  section](https://github.com/mozilla-ocho/llamafile/?tab=readme-ov-file#gotchas)
53
  of the README.
54
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
55
  ## About llamafile
56
 
57
  llamafile is a new format introduced by Mozilla Ocho on Nov 20th 2023.
 
52
  section](https://github.com/mozilla-ocho/llamafile/?tab=readme-ov-file#gotchas)
53
  of the README.
54
 
55
+ ## Prompting
56
+
57
+ Prompt template:
58
+
59
+ ```
60
+ <|begin_of_text|><|start_header_id|>system<|end_header_id|>
61
+ {{prompt}}<|eot_id|>{{history}}<|start_header_id|>{{char}}<|end_header_id|>
62
+ ```
63
+
64
+ History template:
65
+
66
+ ```
67
+ <|start_header_id|>{{name}}<|end_header_id|>
68
+ {{message}}<|eot_id|>
69
+ ```
70
+
71
+ Command template:
72
+
73
+ ```
74
+ ./Meta-Llama-3-8B-Instruct.Q4_0.llamafile -p "[INST]{{prompt}}[/INST]"
75
+ ```
76
+
77
  ## About llamafile
78
 
79
  llamafile is a new format introduced by Mozilla Ocho on Nov 20th 2023.