| FROM ./ggml-model-f16.gguf | |
| FROM ./mmproj-model-f16.gguf | |
| SYSTEM "A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions." | |
| TEMPLATE "{{ .System }} USER: {{ .Prompt }} ASSISTANT:" | |
| PARAMETER temperature 0.0 | |
| PARAMETER num_ctx 4096 | |