GitHub repository: vital121/MoE-LLaVA
Description: MoE-LLaVA is a "Mixture of Experts" model for large visual language models that has high performance and fewer parameters, outperforms larger models in some aspects, and allows learning multimodal interactions using sparse paths.