GitHub repository: EfficientMoE/MoE-Gen
Primary language: Python
Description: High-throughput offline inference for MoE models with limited GPU memory.