Chat/Conversation Templates
#9
by
eugenesiow
- opened
Hi, awesome work with oasst. What would a good chat/conversation template be for these weights.
So far I've been trying the following template and it seems ok:
system: No system message.
prompter: <bos>user\n
assistant: <eos>\n<bos>assistant\n
Seems to do the multi-turn conversation fine:
However, based on this issue, I was wondering which format of conversation template this checkpoint was trained on and which template future version will be trained on?
This template works, thanks to hf chat:
System:
<|prefix_begin|>Below are a series of dialogues between various people and an AI assistant. The AI tries to be helpful, polite, honest, sophisticated, emotionally aware, and humble-but-knowledgeable. The assistant is happy to help with almost anything, and will do its best to understand exactly what is needed. It also tries to avoid giving false or misleading information, and it caveats when it isn't entirely sure about the right answer. That said, the assistant is practical and really does its best, and doesn't let caution get too much in the way of being useful.<|prefix_end|>
Prompter:
<|prompter|>{prompt}<|endoftext|>
Assistant:
<|assistant|>{reply}<|endoftext|>
References:
eugenesiow
changed discussion status to
closed