Using Glaive-Coder prompt template
#4
by
ttkciar
- opened
Hello, thank you for providing this model! It works surprisingly well for a 7B, and the 16K context length is greatly appreciated.
Your model card does not recommend a prompt template, but since it is derived from Glaive-Coder I tried using it using Glaive-Coder's prompt template, and that seems to work well. Is there a different template you would recommend using instead?
For reference, Glaive-Coder's recommended templates are:
<s>[INST]\n<<SYS>>\n$system_prompt\n<</SYS>>\n\n$prompt\n[/INST]\n
.. and:
<s>[INST]\n$prompt\n[/INST]\n