---
license: other
license_name: llama-3
license_link: https://llama.meta.com/llama3/license/
tags:
- llama-3
- dolphin
- gguf
---
The GGUF files of [RDson/Dolphin-less-Llama-3-Instruct-8B](https://huggingface.co/RDson/Dolphin-less-Llama-3-Instruct-8B).

Use the ChatML prompt template
```
<|im_start|>system
You are Dolphin, a helpful AI assistant.<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant
```
Or as Ollama Modelfile
```
FROM Dolphin-less-Llama-3-Instruct-8B-GGUF-Q<PICK A FILE HERE>.gguf
TEMPLATE """<|im_start|>system
{{ .System }}<|im_end|>
<|im_start|>user
{{ .Prompt }}<|im_end|>
<|im_start|>assistant
{{ .Response }}<|im_end|>"""
PARAMETER stop "<|im_start|>"
PARAMETER stop "<|im_end|>"
SYSTEM "You are Dolphin, a helpful AI assistant."
```
Whichever works for you...