benhaotang
commited on
Commit
•
5b88486
1
Parent(s):
8490e49
Update README.md
Browse files
README.md
CHANGED
@@ -12,6 +12,21 @@ tags:
|
|
12 |
This model was converted to GGUF format from [`benhaotang/nemo-math-science-philosophy-12B`](https://huggingface.co/benhaotang/nemo-math-science-philosophy-12B) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
|
13 |
Refer to the [original model card](https://huggingface.co/benhaotang/nemo-math-science-philosophy-12B) for more details on the model.
|
14 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
15 |
## Use with llama.cpp
|
16 |
Install llama.cpp through brew (works on Mac and Linux)
|
17 |
|
|
|
12 |
This model was converted to GGUF format from [`benhaotang/nemo-math-science-philosophy-12B`](https://huggingface.co/benhaotang/nemo-math-science-philosophy-12B) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
|
13 |
Refer to the [original model card](https://huggingface.co/benhaotang/nemo-math-science-philosophy-12B) for more details on the model.
|
14 |
|
15 |
+
## Use with Ollama
|
16 |
+
|
17 |
+
```
|
18 |
+
TEMPLATE """{{ if .System }}[INST]system
|
19 |
+
{{ .System }}[\INST]
|
20 |
+
{{ end }}{{ if .Prompt }}[INST]user
|
21 |
+
{{ .Prompt }}[\INST]
|
22 |
+
{{ end }}[INST]assistant
|
23 |
+
{{ .Response }}[\INST]</s>
|
24 |
+
"""
|
25 |
+
|
26 |
+
PARAMETER stop "</s>"
|
27 |
+
PARAMETER stop "[\INST]"
|
28 |
+
```
|
29 |
+
|
30 |
## Use with llama.cpp
|
31 |
Install llama.cpp through brew (works on Mac and Linux)
|
32 |
|