Regarding fine tune the instruct model
Hi
If I want to fine tune the instruct model, I have three column available in excel . i.e. Prompt, Context and Response.
What type of format should I use to fine tune the model. How many epoch should I use?
Any guide / help will appreciate.
Thank you
Hello,
messages = [
{"role": "user", "content": "Prompt + Context"},
{"role": "assistant", "content": "Response"},
]
tokenizer.set_default_template= False
prompt = pipe.tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
Oh I apologize this one it was a messed up attempt at doing something different it didn't quite work out like I planned can't really do anything with it I tried to replicate myself if kept hallucinating after the third sentence
Hi
@sirrosendo
Even I experienced of hallucination with instruct model, is there any way that we can fine tune the model which stops hallucination.
Can I use
@PierreColombo
prompt structure?
Thank you
You can try using PierreColombo's prompt structure as a starting point for fine-tuning the Instruct model. Remember to use high-quality data to minimize hallucination during fine-tuning.