GitHub repository: Constantine3/MoEBERT
Primary language: Python
Description: This PyTorch package implements MoEBERT: from BERT to Mixture-of-Experts via Importance-Guided Adaptation (NAACL 2022).