mlabonne

/

phixtral-4x2_8

like 203

Nice, thanks a lot!

Thanks a lot @vince62s for the eval!!
I am trying to run in my colab VM (A100) and with this params I am getting errors. Do you have the used script there?

you won't be able to run it because MS updated their configuration_phi.py / modeling_phi.py files.
either you copy them back from an older phi-2 equivalent (like phi dolphin) or you upgrade your weights with the new layer names.

Thanks for the clarification!