GitHub repository: AviSoori1x/makeMoE
Primary language: Jupyter Notebook
Created: 2024-01-22T19:04:59Z
Description: From scratch implementation of a sparse mixture of experts language model inspired by Andrej Karpathy's makemore :)