Is there any information on which prompt template to use?
#1
by
Debich
- opened
I'm using silly tavern. Tell me, please, do you know what settings should be used in this case on Qwen 2?
Can'T tell you the settings, but from looking at it, the model uses chatml.
Ah damnit I downloaded this non-instruct version.
As for the prompt format for the instruct, it's -cml in llamacpp for chatml, and chat with qwen.txt just contains: You are a helpful assistant.