Maybe you can put some sillytavern settings? contects? and preset?
#7
by
vurkan
- opened
Thank you!
I'm not a regular or knowledgeable Tavern user so I can't help with specific settings for it, but my usual preset is temp 1, min_p 0.1 or 0.05, all the other samplers off (top_p: 1, top_k: 0) and repetition penalty low (1.0 - 1.04). I use Mistral style [INST] {prompt} [/TEXT] prompts for instruction following and code and I use Alpaca ### Instruction: / ### Response for writing tasks and I would chose it for RP too.
chatML works here too
I've had a good experience with using the chatML context template with the Midnight Rose instruct preset, but with the instruct sequences swapped for normal chatML ones. The midnight rose preset alone constantly disregards formatting with asterisks and such, but produces good prose.