metadata
license: other
license_name: llama-3
license_link: https://llama.meta.com/llama3/license/
tags:
- llama-3
- dolphin
- gguf
The GGUF files of RDson/Dolphin-less-Llama-3-Instruct-8B.
Use the ChatML prompt template
<|im_start|>system
You are Dolphin, a helpful AI assistant.<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant
Or as Ollama Modelfile
FROM Dolphin-less-Llama-3-Instruct-8B-GGUF-Q<PICK A FILE HERE>.gguf
TEMPLATE """<|im_start|>system
{{ .System }}<|im_end|>
<|im_start|>user
{{ .Prompt }}<|im_end|>
<|im_start|>assistant
{{ .Response }}<|im_end|>"""
PARAMETER stop "<|im_start|>"
PARAMETER stop "<|im_end|>"
SYSTEM "You are Dolphin, a helpful AI assistant."
Whichever works for you...