Mother of all Training Clusters - a m-ric Collection

m-ric 's Collections

Could be useful one day

Scaling Laws 📏

🚀 Spinning Up in LLMs

🧑‍⚖️ LLM-as-a-judge

🔎⇒💬 RAG

🛣️ Grammar

💡 Interpretability - understanding LLMs

LLM foundations

🔧 Optimization Mechanics 🔧

Open-source AI Releases - August '24

Mother of all Training Clusters

Mother of all Training Clusters

updated Sep 4

https://github.com/NousResearch/DisTrO/blob/main/A_Preliminary_Report_on_DisTrO.pdf

Fire-Flyer AI-HPC: A Cost-Effective Software-Hardware Co-Design for Deep Learning

Paper • 2408.14158 • Published Aug 26 • 3