Base vs instruct

#17
by saireddy - opened

if I have to fine tune using PEFT on question and answering task based on domain specific data. is it advisable to use base or instruct model?

+1, I am trying both, will update the results.

Base better for chat?

Thanks @aaditya , I am working on the same too. Will post once I have the results ready.
@RebornZA if I am not wrong, instruct would be the better option for chat

@pcuenq @philschmid any suggestions or insights on this please?

Meta Llama org

I'd use the base model for this task.

osanseviero changed discussion status to closed

Sign up or log in to comment