Instruct format issues
#4
by
MrHillsss
- opened
ChatML doesn't work at all. It outputs complete nonsense.
Alpaca format works extremely well.
Llama 3 format works well too.
Overall the only fine-tune that's better for RP then the original llama 3 thus far.
Really happy you got into fine-tunes, mister <3
It's chatml but you need to use the llama3 bos
<|begin_of_text|><|im_start|>system
Yeah, you're right, thanks. My habit of skimming over the instructions came back to bite me again lol