Prompt format correct?

#1
by Yuma42 - opened

The original model doesn't have "<|begin_of_text|>" in it's prompt format according to it's model card.

My template comes from interpreting the template in tokenizer_config.json, which appends the bos_token

It's probably that you shouldn't manually include it and it will get included by itself

If you see a second <|begin_of_text|> show up, then yeah it probably shouldn't be included (and I can remove it, but not all tools will necessarily append it)

"you shouldn't manually include it "
Ah ok than I did that correct in that case.

Sign up or log in to comment