FINE TUNING with PEFT MIXTRAL

#17
by TK4000 - opened

How to finetune this dolphin model ? or the base model ? just like all other model with transformer ? or I need to do some adjustment before training ?

@TK4000 did you ever give fine tuning a shot? curious to know if you quantized and what GPU was required.

Sign up or log in to comment