tokenizer chat_template has no role system
#9
by
wnma3mz
- opened
I found that defining a system is not supported in the chat_template of tokenizer_config.json.
Just out of curiosity, other open source llm chat models generally support defining role system. Why didn't gemma do it?
Or is no system a better way?
Surya from the Gemma team here; we decided not to have system instructions to simplify our own pipeline internally a bit (it's not better or worse, per se). We recommend just trying to fit the role in the initial user.
Thanks for your reply.
wnma3mz
changed discussion status to
closed