Template and special tokens understanding
#8
by
yartsiukhou
- opened
From README,
You can use the following template:
<|begin▁of▁sentence|>{system_message}
User: {user_message_1}
Assistant: {assistant_message_1}<|end▁of▁sentence|>User: {user_message_2}
Assistant:
I read it as <bos>bla bla<eos>GARBAGE
. // upd: formatting
So what actually is begin_of_sentence and end_of_sentence. After one sentence ended another one begins, doesn't it?