Instruct Formatting

#3
by brucethemoose - opened

Do these benchmarks use the instruct formatting from the tokenizer config?

If so, I think this would be fairly important to mention, as many models ship without a chat template in the config.

Patronus AI org

No we do not use this

hmmm shouldn't it to give the ones that actually have template in the config a chance to generate best results possible?

Sign up or log in to comment