GitHub repository: BillSchumacher/hlb-gpt
Description: Minimalistic, fast, and experimentation-friendly researcher's toolbench for GPT-like models in <350 lines of code. Reaches <3.8 validation loss on wikitext-103 on a single A100 in just over 6 minutes.