Discord Server
#1
by
Josephgflowers
- opened
Cool, check in on your discord server once and a while, we would have been excited to know about the continued work.
What is the prompt format to be used for finetuning with custom Question answer dataset? Can someone share an example?
@vijaydeshpande Tinyllama generally uses the zephyr chat format. I say generally because the user, system, and assistant portions are not specific tokens (like llama3). So Tinyllama adapts well to other chat formats with training. The discord for tinyllama is moderately active https://discord.gg/mPpsevg9.
@Josephgflowers Thank you for your interest in TinyLlama! However, we currently have no plans for its continued development.
chaoscodes
changed discussion status to
closed