Update README.md
Browse files
README.md
CHANGED
@@ -23,3 +23,47 @@ If you keep going with the wrong first button, you could end up in a black hole
|
|
23 |
By the time you realize it, itโs already too late...
|
24 |
|
25 |
When looking at an LLM, don't trust others, trust yourself by real fact check.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
23 |
By the time you realize it, itโs already too late...
|
24 |
|
25 |
When looking at an LLM, don't trust others, trust yourself by real fact check.
|
26 |
+
|
27 |
+
### Ollama
|
28 |
+
|
29 |
+
## Create
|
30 |
+
```
|
31 |
+
(.venv) jaylee@lees-MacBook-Pro-2 youtube % ./ollama create solo -f ./Modelfile_Q5_K_M
|
32 |
+
transferring model data
|
33 |
+
creating model layer
|
34 |
+
creating template layer
|
35 |
+
creating system layer
|
36 |
+
creating parameters layer
|
37 |
+
creating config layer
|
38 |
+
using already created layer sha256:1acd536b4123837aee2f43ffde8a697f842be5ab4d789ab6787a7887291c4bb3
|
39 |
+
using already created layer sha256:8ab4849b038cf0abc5b1c9b8ee1443dca6b93a045c2272180d985126eb40bf6f
|
40 |
+
using already created layer sha256:ae2974c64ea5d6f488eeb1b10717a270f48fb3452432589db6f5e60472ae96ac
|
41 |
+
using already created layer sha256:74ef6315972b317734fe01e7e1ad5b49fce1fa8ed3978cb66501ecb8c3a2e984
|
42 |
+
writing layer sha256:88698c3b47bc90bf85949d927c7555efe424e666ef9bd94550bcbde9c4f94489
|
43 |
+
writing manifest
|
44 |
+
success
|
45 |
+
```
|
46 |
+
|
47 |
+
## Modelfile
|
48 |
+
```
|
49 |
+
FROM solo-llama-3-maal-mlp-koen-8b-Q5_K_M.gguf
|
50 |
+
TEMPLATE """{{ if .System }}<|start_header_id|>system<|end_header_id|>
|
51 |
+
|
52 |
+
{{ .System }}<|eot_id|>{{ end }}{{ if .Prompt }}<|start_header_id|>user<|end_header_id|>
|
53 |
+
|
54 |
+
{{ .Prompt }}<|eot_id|>{{ end }}<|start_header_id|>assistant<|end_header_id|>
|
55 |
+
|
56 |
+
{{ .Response }}<|eot_id|>"""
|
57 |
+
|
58 |
+
|
59 |
+
SYSTEM """
|
60 |
+
์น์ ํ ์ฑ๋ด์ผ๋ก์ ์๋๋ฐฉ์ ์์ฒญ์ ์ต๋ํ ์์ธํ๊ณ ์น์ ํ๊ฒ ๋ตํ์. ๋ชจ๋ ๋๋ต์ ํ๊ตญ์ด(Korean)์ผ๋ก ๋๋ตํด์ค.
|
61 |
+
"""
|
62 |
+
|
63 |
+
PARAMETER num_keep 24
|
64 |
+
PARAMETER temperature 0.7
|
65 |
+
PARAMETER num_predict 3000
|
66 |
+
PARAMETER stop "<|start_header_id|>"
|
67 |
+
PARAMETER stop "<|end_header_id|>"
|
68 |
+
PARAMETER stop "<|eot_id|>"
|
69 |
+
```
|