mocle-cluster256 / README.md
KaiChen1998's picture
Update README.md
073bcc7 verified
metadata
license: apache-2.0

MoCLE Model Card

MoCLE is a Multi-modality Large Language Model (MLLM) with a Mixture-of-Experts (MoE) architecture for instruction customization and generalization based on InstructBLIP. This repo contains the MoCLE cluster model with 256 instruction clusters based on SentenceBERT. Check detailed usage in our Github repo and Website.