Chat template in the tokenizer_config.json file does not have tool calls
#10
by
iamz80
- opened
Hello!
It is probably a minor bug for the commit SHA256: e5e6759. This model's file tokenizer_config.json "chat_template" parameter does not contain tool calls at all. Due to that the model as-is ignores tools provided into tokenizer.apply_chat_template() tools argument.
The fix I've found working is replacing the file in question by the one from, for example, Mistral-Instruct-Large-2407. It starts working again.
Thank you!