Tokenizer is match？especially for function / tool call
#31
by
zhouzr
- opened
Mistral 8x22b tokenizer support tool and function natively, I am not sure llamacpp server integrete this already.
Llama.cpp has the correct tokenizer, you just need to match the template the way they use it. (that's something they didn't share as a chat_template in their tokenizer config). But it works, the tokenizer os the correct one.