preferred chat template? context size?
#2
by
cognitivetech
- opened
I tried mistral prompt template and 8k context but maybe that's not best?
That sounds pretty good actually. 8k context is correct. Different chat templates can be used, like the Mistral's on ChatML.