GitHub repository: lucidrains/mixture-of-experts
Primary language: Python
Created: 2020-07-13T18:23:36Z
Description: A Pytorch implementation of Sparsely-Gated Mixture of Experts, for massively increasing the parameter count of language models