GitHub repository: kyegomez/SwitchTransformers
Primary language: Python
Created: 2024-01-22T11:38:13Z
Description: Implementation of Switch Transformers from the paper: "Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity"