recommended prompt structure
#12
by
rozek
- opened
Hello,
I've been experimenting with "stablelm-zephyr-3b" for quite a while now - with mediocre results until I (accidentally) formatted my prompt without the recommended <|endoftext|> - and suddenly, I got exciting results!
Hence my question: is the prompt example shown in the model card really correct?
Hi, will you please share your input prompt format. I am also trying out various prompt styles to get a better result for a common input prompt. It would be helpful to know yours :)
Sure, here is what I am using right now (based on the example from the model card):
<|user|>
List 3 synonyms for the word "tiny"
<|assistant|>
1. Dwarf
2. Little
3. Petite
Thus, simply omit the <|endoftext|>, that's it!
This is a good question. I would like to know as well.
Me too :)