TencentARC

/

LLaMA-Pro-8B-Instruct

like 58

I tested 4 formats as part of my evaluation, this was the only one that worked:

<s>[INST] <<SYS>>
Provide answers in Python.  The code must start with ```python and end with ```.
<</SYS>>

<prompt-here>[/INST]

Tweak system prompt as appropriate.

Following up on this, it doesn't look like the chat template is defined correctly from commit 9850c8afce19a69d8fc4a1603a82441157514016. It only accounts for the user and assistant roles (i.e. doesn't include the system role). Consequently, any system prompts being provided are currently being ignored.