Prompt format?
#3
by
SinanAkkoyun
- opened
Hello, I have been wondering what the right prompt format is?
The chatml variant you present in the model card seems to somewhat work but the system prompt seems to be completely disregarded. Also, if I read that correctly, your PROMPT_FORMAT in the zephyr-chat space is some sort of Llama prompt format?
Thank you for the help
You can checkout it here. See chat_template
You can use: tokenizer.apply_chat_template() to get exact prompt for chat.
format:
# <|system|>
# You are a friendly chatbot who always responds in the style of a pirate.</s>
# <|user|>
# How many helicopters can a human eat in one sitting?</s>
# <|assistant|>
I have some doubts if <|system|>, <|user|>,<|assistant|> are added tokens "<|system|>" or is it just pure text to be predicted?