Prompt Format
#2
by
lastrosade
- opened
Very confused at what prompt format I should use with this,
mistral-7b-v0.1-layla-v4 gives me this:
USER:
ASSISTANT:
While InfinityRP-v1-7B gives me this blurb of text without format:
"You are now in roleplay chat mode. Engage in an endless chat with {{user}}. Always wait {{user}} turn, next actions and responses."
Would you mind giving me a clear template to use?
The first one seems to work, but there might be one that gives better results.
It's a merge between the two models without any additional finetuning, there is no clear template. It should work fine with chatml or alpaca, the blurb of text you mentioned is a system prompt - choose whatever you wish. I no longer list recommendations for formats/prompts and will not, as this comes down to user preference with most of the models i put up.
lastrosade
changed discussion status to
closed