convert phi to phixtral
#4
by
NickyNicky
- opened
Thank you very much for the model, how could I convert to Mixed Experts?
can you be more specific ? what are you trying to achieve?
I really like LLMs and I want to obtain more knowledge, that's what I want to achieve.
Do you have any script to be able to replicate a Mix?
thank you so much.
this is not the best thing to learn machine learning but here is if you want to read: https://github.com/cg123/mergekit