asiansoul commited on
Commit
4d3a0f8
โ€ข
1 Parent(s): c06b349

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +44 -0
README.md CHANGED
@@ -23,3 +23,47 @@ If you keep going with the wrong first button, you could end up in a black hole
23
  By the time you realize it, itโ€™s already too late...
24
 
25
  When looking at an LLM, don't trust others, trust yourself by real fact check.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
23
  By the time you realize it, itโ€™s already too late...
24
 
25
  When looking at an LLM, don't trust others, trust yourself by real fact check.
26
+
27
+ ### Ollama
28
+
29
+ ## Create
30
+ ```
31
+ (.venv) jaylee@lees-MacBook-Pro-2 youtube % ./ollama create solo -f ./Modelfile_Q5_K_M
32
+ transferring model data
33
+ creating model layer
34
+ creating template layer
35
+ creating system layer
36
+ creating parameters layer
37
+ creating config layer
38
+ using already created layer sha256:1acd536b4123837aee2f43ffde8a697f842be5ab4d789ab6787a7887291c4bb3
39
+ using already created layer sha256:8ab4849b038cf0abc5b1c9b8ee1443dca6b93a045c2272180d985126eb40bf6f
40
+ using already created layer sha256:ae2974c64ea5d6f488eeb1b10717a270f48fb3452432589db6f5e60472ae96ac
41
+ using already created layer sha256:74ef6315972b317734fe01e7e1ad5b49fce1fa8ed3978cb66501ecb8c3a2e984
42
+ writing layer sha256:88698c3b47bc90bf85949d927c7555efe424e666ef9bd94550bcbde9c4f94489
43
+ writing manifest
44
+ success
45
+ ```
46
+
47
+ ## Modelfile
48
+ ```
49
+ FROM solo-llama-3-maal-mlp-koen-8b-Q5_K_M.gguf
50
+ TEMPLATE """{{ if .System }}<|start_header_id|>system<|end_header_id|>
51
+
52
+ {{ .System }}<|eot_id|>{{ end }}{{ if .Prompt }}<|start_header_id|>user<|end_header_id|>
53
+
54
+ {{ .Prompt }}<|eot_id|>{{ end }}<|start_header_id|>assistant<|end_header_id|>
55
+
56
+ {{ .Response }}<|eot_id|>"""
57
+
58
+
59
+ SYSTEM """
60
+ ์นœ์ ˆํ•œ ์ฑ—๋ด‡์œผ๋กœ์„œ ์ƒ๋Œ€๋ฐฉ์˜ ์š”์ฒญ์— ์ตœ๋Œ€ํ•œ ์ž์„ธํ•˜๊ณ  ์นœ์ ˆํ•˜๊ฒŒ ๋‹ตํ•˜์ž. ๋ชจ๋“  ๋Œ€๋‹ต์€ ํ•œ๊ตญ์–ด(Korean)์œผ๋กœ ๋Œ€๋‹ตํ•ด์ค˜.
61
+ """
62
+
63
+ PARAMETER num_keep 24
64
+ PARAMETER temperature 0.7
65
+ PARAMETER num_predict 3000
66
+ PARAMETER stop "<|start_header_id|>"
67
+ PARAMETER stop "<|end_header_id|>"
68
+ PARAMETER stop "<|eot_id|>"
69
+ ```