If model uses custom prompt template - you needed to add this chat template to config file There is some examples: Will be added to readme later... empty template ```json "context_prompt_begin": "", "context_prompt_end": "", "user_prompt_begin": "", "user_prompt_end": "", "bot_prompt_begin": "", "bot_prompt_end": "", ``` ChatML ``` <|im_start|>system {context} <|im_end|> <|im_start|> {prompt} <|im_end|> <|im_start|> {answer} <|im_end|> ``` ```json "context_prompt_begin": "<|im_start|>system\n", "context_prompt_end": "<|im_end|>", "user_prompt_begin": "<|im_start|>\n", "user_prompt_end": "<|im_end|>", "bot_prompt_begin": "<|im_start|>\n", "bot_prompt_end": "<|im_end|>", ``` Llama 2 ``` [INST] <> {context} <> [/INST] [INST] {prompt} [/INST] {answer} ``` ```json "context_prompt_begin": "[INST] <>\n", "context_prompt_end": "<>", "user_prompt_begin": "[INST]\n", "user_prompt_end": "[/INST]", "bot_prompt_begin": "", "bot_prompt_end": "", ``` LimaRP-Alpaca ``` ### Instruction: Play the role of Character. You must engage in a roleplaying chat with User below this line. Do not write dialogues and narration for User. Character should respond with messages of medium length. {context} ### Input: {prompt} ### Response: {answer} ``` ```json "context_prompt_begin": "### Instruction:\nPlay the role of Character. You must engage in a roleplaying chat with User below this line. Do not write dialogues and narration for User. Character should respond with messages of medium length.\n", "context_prompt_end": "", "user_prompt_begin": "### Input:\n", "user_prompt_end": "\n", "bot_prompt_begin": "### Response:\n", "bot_prompt_end": "\n", ``` Zephyr ``` <|system|> {context} <|user|> {prompt} <|assistant|> {answer} ``` ```json "context_prompt_begin": "<|system|>\n", "context_prompt_end": "", "user_prompt_begin": "<|user|>\n", "user_prompt_end": "", "bot_prompt_begin": "<|assistant|>\n", "bot_prompt_end": "", ```