learning rate for sft anddpo

#2
by aari1995 - opened

thank you for the great models! I would like to ask if you have any experience / advice in what direction the learning rate could go for this, (and / or the 4b and 7b) model.

Thank you!!

Sign up or log in to comment