Format type

#2
by GhostGate - opened

Hi!

I am just curious if the model works better with Mistral format or chatML? Does the model behave differently depending on the format?

Hi!

I am just curious if the model works better with Mistral format or chatML? Does the model behave differently depending on the format?

I personally preferred this one with Chatml, however - the stop token leaking issue didn't seem to occur in mistral format iirc.

Sign up or log in to comment