Template might be Mixtral [INST]
#1
by
Culturedniichan
- opened
The card in your quant says ChatML, and the original model itself makes no mention of it. However, taking a look at the collab notebook:
I do see [INST] there, together with < < SYS > > < </ SYS> > which I personally didn't know.
So I'm not sure. I've used my mistral template to compare with chatML and it does seem to perform better, but then again it might be confirmation bias.