Question about prompt format

#1
by irisxx - opened

Hello, is this model trained followed by original prompt format like this:
QA format using "Instruct: \nOutput:"
or your training processing reconstructed prompt format, and which way should I use when continue training beginning with model "lole25/phi-2-sft-ultrachat-full"?

lole25 changed discussion status to closed
lole25 changed discussion status to open

Hi there,
You can the prompt with the default chatml template of Phi-2 model:

"""
<|im_start|>system
{system_message}<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant
"""

Hi there,
You can the prompt with the default chatml template of Phi-2 model:

"""
<|im_start|>system
{system_message}<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant
"""

Thx 😊!

Sign up or log in to comment