GitHub repository: niklassheth/nanoMoE
Primary language: Python
Description: An extension of the nanoGPT repository for training small MOE models. Goal is to port some DeepSeek V3 features