GitHub repository: wolfecameron/nanoMoE
Primary language: Python
Description: An extension of the nanoGPT repository for training medium-sized MOE models.