PhilipMay

/

Phi-3-mini-4k-instruct-LLaMAfied-8xMoE-raw

like 1

mergekit-moe moe3phi.yml TestPhi-3x4B --trust-remote-code

ERROR:root:No output architecture found that is compatible with the given models.
ERROR:root:All supported output architectures:
ERROR:root:  * Mixtral
ERROR:root:  * DeepSeek MoE

Seems like mergekit doesn't support phi3 architecture at all