GitHub repository: kyegomez/Mixture-of-Depths
Primary language: Python
Created: 2024-04-05T00:51:21Z
Description: Implementation of the paper: "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"