This is how MoE is done. Kudos.

#4
by Kquant03 - opened

Fine tuning it is truly so helpful to the model.

TomGrc changed discussion status to closed

Sign up or log in to comment