benhaotang commited on
Commit
5b88486
1 Parent(s): 8490e49

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +15 -0
README.md CHANGED
@@ -12,6 +12,21 @@ tags:
12
  This model was converted to GGUF format from [`benhaotang/nemo-math-science-philosophy-12B`](https://huggingface.co/benhaotang/nemo-math-science-philosophy-12B) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
13
  Refer to the [original model card](https://huggingface.co/benhaotang/nemo-math-science-philosophy-12B) for more details on the model.
14
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
15
  ## Use with llama.cpp
16
  Install llama.cpp through brew (works on Mac and Linux)
17
 
 
12
  This model was converted to GGUF format from [`benhaotang/nemo-math-science-philosophy-12B`](https://huggingface.co/benhaotang/nemo-math-science-philosophy-12B) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
13
  Refer to the [original model card](https://huggingface.co/benhaotang/nemo-math-science-philosophy-12B) for more details on the model.
14
 
15
+ ## Use with Ollama
16
+
17
+ ```
18
+ TEMPLATE """{{ if .System }}[INST]system
19
+ {{ .System }}[\INST]
20
+ {{ end }}{{ if .Prompt }}[INST]user
21
+ {{ .Prompt }}[\INST]
22
+ {{ end }}[INST]assistant
23
+ {{ .Response }}[\INST]</s>
24
+ """
25
+
26
+ PARAMETER stop "</s>"
27
+ PARAMETER stop "[\INST]"
28
+ ```
29
+
30
  ## Use with llama.cpp
31
  Install llama.cpp through brew (works on Mac and Linux)
32