jartine commited on
Commit
14332f5
1 Parent(s): 7d67dc0

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +22 -0
README.md CHANGED
@@ -46,6 +46,28 @@ Having **trouble?** See the ["Gotchas"
46
  section](https://github.com/mozilla-ocho/llamafile/?tab=readme-ov-file#gotchas)
47
  of the README.
48
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
49
  ## About llamafile
50
 
51
  llamafile is a new format introduced by Mozilla Ocho on Nov 20th 2023.
 
46
  section](https://github.com/mozilla-ocho/llamafile/?tab=readme-ov-file#gotchas)
47
  of the README.
48
 
49
+ ## Prompting
50
+
51
+ Prompt template:
52
+
53
+ ```
54
+ <|begin_of_text|><|start_header_id|>system<|end_header_id|>
55
+ {{prompt}}<|eot_id|>{{history}}<|start_header_id|>{{char}}<|end_header_id|>
56
+ ```
57
+
58
+ History template:
59
+
60
+ ```
61
+ <|start_header_id|>{{name}}<|end_header_id|>
62
+ {{message}}<|eot_id|>
63
+ ```
64
+
65
+ Command template:
66
+
67
+ ```
68
+ ./Meta-Llama-3-8B-Instruct.Q4_0.llamafile -p "[INST]{{prompt}}[/INST]"
69
+ ```
70
+
71
  ## About llamafile
72
 
73
  llamafile is a new format introduced by Mozilla Ocho on Nov 20th 2023.