GitHub repository: simudt/Mixture-of-Depths-Jax
Primary language: Python
Created: 2024-04-10T06:56:03Z
Description: Jax module for the paper: "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"