In Oobabooga what Instruction template do I select for Dolphin Mistral 2.1?
It used to default to Guanaco and seems to work well. Now after reinstalling fresh it's defaulting to Alpaca but I have not tested it? Do I need to load a custom Instruction template for best results? Please weight in people thank you.
I have been using it in Instruct Mode? You know how you have Chat, Chat-instruct and Instruct. I have been choosing Instruct.
And on the Parameters Tab under Instruction template that's were it used to sat Guanaco. What should I select there for best results?
I notice how some people choose the Default tab instead of Instruct should I do that too?
Update I seem to read that I should choose ChatML as Instruction template.
I seem to be getting situations were the AI starts like asking itself on behalf of the user. It will end a prompt with <|im_end|>
<|im_start|>user
And then start typing something like I would say? Any suggestions how to prevent this?