Chat template in the tokenizer_config.json file does not have tool calls

#10
by iamz80 - opened

Hello!

It is probably a minor bug for the commit SHA256: e5e6759. This model's file tokenizer_config.json "chat_template" parameter does not contain tool calls at all. Due to that the model as-is ignores tools provided into tokenizer.apply_chat_template() tools argument.

The fix I've found working is replacing the file in question by the one from, for example, Mistral-Instruct-Large-2407. It starts working again.

Thank you!

Sign up or log in to comment