morph-labs

/

rift-coder-v0-7b-gguf

like 30

Hello, thank you for providing this model! It works surprisingly well for a 7B, and the 16K context length is greatly appreciated.

Your model card does not recommend a prompt template, but since it is derived from Glaive-Coder I tried using it using Glaive-Coder's prompt template, and that seems to work well. Is there a different template you would recommend using instead?

For reference, Glaive-Coder's recommended templates are:

<s>[INST]\n<<SYS>>\n$system_prompt\n<</SYS>>\n\n$prompt\n[/INST]\n

.. and:

<s>[INST]\n$prompt\n[/INST]\n