GitHub repository: EfficientMoE/MoE-Infinity
Primary language: Python
Description: PyTorch library for cost-effective, fast and easy serving of MoE models.