view article Article Introducing Olmo-core 3: Open, scalable training infrastructure for large MoEs allenai • 7 days ago • 25
OpenFineTrain Collection Very fine 55 trillion+ tokens worth of ungated huggingface datasets for LLM training across 80+ datasets. • 92 items • Updated 1 day ago • 9
view post Post 285 NEW CLAUDE HAIKU MODEL COMINGFINALLY AFTER A YEARANTHROPIC ANNOUNCED HAIKU 5.5 ❤️ 6 6 + Reply
view reply Basically I didn’t match Muon and AdamW up together. In the morning I can get the actual details. At just 3B tokens, Boris-2-0917, as I’ve taken to calling it, has already beaten the 30B checkpoint on all benchmarks.