Can I fine tune the Qwen MOE?

#2
by Imran1 - opened

Hy, I would like to fine tune the qwen mixture of expert model using Qwen2moe model Class.
Should the output model will be mixture of expert?

Sign up or log in to comment