50M Parameter Hybrid Mamba-2 + GQA Transformer trained on English Cosmopedia, Coding, & Educational Datasets. Trained on a single NVIDIA A100 80GB (Brev).
Files info
