Some mistake using <s> and </s>

#4
by qwertyuu - opened

It seems that, in the readme of mixtral, they explain the difference between [INST] and <s> as respectively a string and a token

"Note that and are special tokens for beginning of string (BOS) and end of string (EOS) while [INST] and [/INST] are regular strings."
As seen in the "instruction format" section of the readme here: https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1

Just so you know!

Thanks for making this cute and available app for us!

[INST] Instruction [/INST] Model answer [INST] Follow-up instruction [/INST]

Sign up or log in to comment