asiansoul commited on
Commit
4bbf81e
β€’
1 Parent(s): 0ce1261

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +13 -14
README.md CHANGED
@@ -74,27 +74,26 @@ Modelfile_Q5_K_M
74
 
75
  ```
76
  FROM joah-llama-3-koen-8b-coder-v2-Q5_K_M.gguf
77
- TEMPLATE """
78
- {{- if .System }}
79
- system
80
- <s>{{ .System }}</s>
81
- {{- end }}
82
- user
83
- <s>Human:
84
- {{ .Prompt }}</s>
85
- assistant
86
- <s>Assistant:
87
- """
88
 
89
  SYSTEM """
90
  μΉœμ ˆν•œ μ±—λ΄‡μœΌλ‘œμ„œ μƒλŒ€λ°©μ˜ μš”μ²­μ— μ΅œλŒ€ν•œ μžμ„Έν•˜κ³  μΉœμ ˆν•˜κ²Œ λ‹΅ν•˜μž. λͺ¨λ“  λŒ€λ‹΅μ€ ν•œκ΅­μ–΄(Korean)으둜 λŒ€λ‹΅ν•΄μ€˜.
91
  """
92
 
 
93
  PARAMETER temperature 0.7
94
  PARAMETER num_predict 3000
95
- PARAMETER num_ctx 4096
96
- PARAMETER stop "<s>"
97
- PARAMETER stop "</s>"
 
98
  ```
99
 
100
  ```
 
74
 
75
  ```
76
  FROM joah-llama-3-koen-8b-coder-v2-Q5_K_M.gguf
77
+ TEMPLATE """{{ if .System }}<|start_header_id|>system<|end_header_id|>
78
+
79
+ {{ .System }}<|eot_id|>{{ end }}{{ if .Prompt }}<|start_header_id|>user<|end_header_id|>
80
+
81
+ {{ .Prompt }}<|eot_id|>{{ end }}<|start_header_id|>assistant<|end_header_id|>
82
+
83
+ {{ .Response }}<|eot_id|>"""
84
+
 
 
 
85
 
86
  SYSTEM """
87
  μΉœμ ˆν•œ μ±—λ΄‡μœΌλ‘œμ„œ μƒλŒ€λ°©μ˜ μš”μ²­μ— μ΅œλŒ€ν•œ μžμ„Έν•˜κ³  μΉœμ ˆν•˜κ²Œ λ‹΅ν•˜μž. λͺ¨λ“  λŒ€λ‹΅μ€ ν•œκ΅­μ–΄(Korean)으둜 λŒ€λ‹΅ν•΄μ€˜.
88
  """
89
 
90
+ PARAMETER num_keep 24
91
  PARAMETER temperature 0.7
92
  PARAMETER num_predict 3000
93
+ PARAMETER num_ctx 64000
94
+ PARAMETER stop "<|start_header_id|>"
95
+ PARAMETER stop "<|end_header_id|>"
96
+ PARAMETER stop "<|eot_id|>"
97
  ```
98
 
99
  ```