Base vs instruct

#17

by saireddy - opened Apr 19

Discussion

saireddy

Apr 19

•

edited Apr 19

if I have to fine tune using PEFT on question and answering task based on domain specific data. is it advisable to use base or instruct model?

aaditya

Apr 20

+1, I am trying both, will update the results.

RebornZA

Apr 20

Base better for chat?

saireddy

Apr 20

Thanks @aaditya , I am working on the same too. Will post once I have the results ready.
@RebornZA if I am not wrong, instruct would be the better option for chat

saireddy

Apr 23

@pcuenq @philschmid any suggestions or insights on this please?

pcuenq

Meta Llama org Apr 23

I'd use the base model for this task.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment