mlabonne

/

phixtral-4x2_8

like 204

Hi @mlabonne , I'am trying to make a MoE out of Falcon 7B just as a toy weekend project using your notebook LazyMergeKit and got into this error and i'am wondering if you happen to know any work around !? someway to fix that ?
Thanks in advance and looking forward to hear back from you again 🤗