What is the stop token for this model please
#194
by
NigelTheMaker
- opened
I'm trying to iterate until the stop token, does anyone know what it is please?
Hi there? It should stop by itself tho? But the EOS is </s> (the BOS should be <s>), you can check this on the chat template,btw you might want to consider switching to the Instruct V0.2?
Ops my bad thought I was in Mistral7B for a moment-
But yeah, </s> should do.