What's the prompt template for the chat model?
#4
by
apepkuss79
- opened
What's the prompt template for the chat model? Thanks a lot!
The chat template format is ChatML, which can be found in tokenizer_config.json, you can convert messages to correct prompt by tokenizer.apply_chat_template
<|im_start|>system
{system_message}<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant
@Kai01ai Thanks for the quick reply! 赞
apepkuss79
changed discussion status to
closed