Template for Wizard

#7
by Kilmeran - opened

I see you mentioned using the template associated with the base model. I use Wizard 8x22b a lot. Originally, that is the Mixstral (Minstral) base model, but Wizard usually says to use Alpaca. Would it be better to use Alpaca, then, or Minstral?

Bardzo dobre pytanie, kolego Szczepanik :-P Nie mam pojęcia. To be clear - some models, even though they're trained on a given template, also work well when you switch to different ones. For instance, many Mistral tunes work both with ChatML & Mistral instruct templates. It's usually best using a template, which model/tune makers suggest. They test it, they train a model/tune on it - thus - it works. It does not mean that the other templates will not work though :-P Honestly, I've got no idea. I have not tried this model. I know that Wizard stuff is good but I moved away from it a year ago or something - when the old Wizard tunes were replaced by lots of newer models.

You need to try, I guess. I often try different templates with different models - even if they're not the "native" ones.

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment