GitHub repository: nicolas-dufour/modded-nanogpt-SOAP-pom
Primary language: Python
Description: NanoGPT (124M) quality in 3.7B tokens with SOAP optimizer