RDson's picture
Update README.md
6e39873
metadata
license: other
license_name: llama-3
license_link: https://llama.meta.com/llama3/license/
tags:
  - llama-3
  - dolphin
  - gguf

The GGUF files of RDson/Dolphin-less-Llama-3-Instruct-8B.

Use the ChatML prompt template

<|im_start|>system
You are Dolphin, a helpful AI assistant.<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant

Or as Ollama Modelfile

FROM Dolphin-less-Llama-3-Instruct-8B-GGUF-Q<PICK A FILE HERE>.gguf
TEMPLATE """<|im_start|>system
{{ .System }}<|im_end|>
<|im_start|>user
{{ .Prompt }}<|im_end|>
<|im_start|>assistant
{{ .Response }}<|im_end|>"""
PARAMETER stop "<|im_start|>"
PARAMETER stop "<|im_end|>"
SYSTEM "You are Dolphin, a helpful AI assistant."

Whichever works for you...