Thank you
#1
by
MB7977
- opened
Thanks so much for training a 16K version. The LongLoRA approach is the best I've worked with in open models, really appreciate your work. I presume this uses the Llama 2 prompt format like the updated Alpaca models?
Hi,
Many thanks for your comment. For this model, its prompt format also follows the Llama2 prompt format. And we do not include system prompt for supervised fine-tuning.
You can simply use the line below for it.
f"[INST]{instruction}[/INST]"
Regards,
Yukang Chen
Thank you.