Running 3.94k The Ultra-Scale Playbook 🌌 3.94k The ultimate guide to training LLM on large GPU Clusters
Running on CPU Upgrade Featured 3.24k The Smol Training Playbook 📚 3.24k The secrets to building world-class LLMs
view article Article Mixture of Experts Explained +4 osanseviero, lewtun, philschmid, smangrul, ybelkada, pcuenq • Dec 11, 2023 • 1.15k
view article Article A Gentle Introduction to 8-bit Matrix Multiplication for transformers at scale using transformers, accelerate and bitsandbytes ybelkada, timdettmers • Aug 17, 2022 • 136