Attention Heads of Large Language Models: A Survey
Paper
•
2409.03752
•
Published
•
88
LLM
-
-
Transformer Explainer: Interactive Learning of Text-Generative Models
Paper • 2408.04619 • Published • 155 -
Addition is All You Need for Energy-efficient Language Models
Paper • 2410.00907 • Published • 144 -
DoReMi: Optimizing Data Mixtures Speeds Up Language Model Pretraining
Paper • 2305.10429 • Published • 3