chat template missing in tokenizer_config.json?

#9
by whaleloops - opened

Hi Locutusque,
Thanks for sharing.
Can you confirm that chat template is the same as https://huggingface.co/meta-llama/Meta-Llama-3-8B (copied below)?
"chat_template": "{% set loop_messages = messages %}{% for message in loop_messages %}{% set content = '<|start_header_id|>' + message['role'] + '<|end_header_id|>\n\n'+ message['content'] | trim + '<|eot_id|>' %}{% if loop.index0 == 0 %}{% set content = bos_token + content %}{% endif %}{{ content }}{% endfor %}{{ '<|start_header_id|>assistant<|end_header_id|>\n\n' }}"

Hello, this is the incorrect chat template. I uploaded the correct one. Thank you for bringing this oversight to my attention.

Locutusque changed discussion status to closed

Sign up or log in to comment