davidmrau/mixture-of-experts: PyTorch Re-Implementation of "The Sparsely-Gated Mixture-of-Experts Layer" by Noam Shazeer et al. https://arxiv.org/abs/1701.06538
Category: ml
Language: Python
Topics: mixture-of-experts, moe, pytorch, re-implementation, sparsely-gated-mixture-of-experts