GitHub repository: serp-ai/Parameter-Efficient-MoE
Primary language: Python
Description: Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks