BramVanroy commited on
Commit
ffeaee4
1 Parent(s): 290bb12

Upload Modelfile_q4_k_m with huggingface_hub

Browse files
Files changed (1) hide show
  1. Modelfile_q4_k_m +10 -0
Modelfile_q4_k_m ADDED
@@ -0,0 +1,10 @@
 
 
 
 
 
 
 
 
 
 
 
1
+ FROM ./fietje-2b-instruct-q4_k_m.gguf
2
+ TEMPLATE """{{ if .System }}<|im_start|>system
3
+ {{ .System }}<|im_end|>
4
+ {{ end }}{{ if .Prompt }}<|im_start|>user
5
+ {{ .Prompt }}<|im_end|>
6
+ {{ end }}<|im_start|>assistant
7
+ """
8
+ PARAMETER num_ctx 2048
9
+ PARAMETER stop "<|im_start|>"
10
+ PARAMETER stop "<|im_end|>"