What am I doing wrong? Using Oobabooga.
#1
by
Goldenblood56
- opened
Using fairly default setting. Ooba is fully updated. Llama.cpp using 8-bit quant.
Well other prompts are not so bad. Maybe it just responds poorly to hello.
Try this Template and see results:
TEMPLATE """{{ if .System }}
<|im_start|>system {{ .System }}<|im_end|>
{{- end }}
<|im_start|>user
{{ .Prompt }}<|im_end|>
<|im_start|>assistant
"""
SYSTEM """"""
PARAMETER stop <|im_start|>
PARAMETER stop <|im_end|>
@Goldenblood56 as @Miro7 pointed out this Dolphin uses a ChatML format
Thanks I will have to give that a try.
munish0838
changed discussion status to
closed