Template and special tokens understanding

#8
by yartsiukhou - opened

From README,

You can use the following template:

<|begin▁of▁sentence|>{system_message}

User: {user_message_1}

Assistant: {assistant_message_1}<|end▁of▁sentence|>User: {user_message_2}

Assistant:

I read it as <bos>bla bla<eos>GARBAGE. // upd: formatting

So what actually is begin_of_sentence and end_of_sentence. After one sentence ended another one begins, doesn't it?

Sign up or log in to comment