ChatML as prompt template
#3
by
vasilee
- opened
hi,
why not use ChatML as the prompt template?
for a long context it is very easy to have content that contains words/tokens similar to the template you are using now ("User:", "Assistant:")
Because this is not a fine-tuned model. It allows you to run simulated Q/A, Instruct, etc templates, but it's not fine-tuned on them. You'd need a finetune to allow ChatML.