Predictable Scale: Part I -- Optimal Hyperparameter Scaling Law in Large Language Model Pretraining Paper • 2503.04715 • Published Mar 6 • 3
Breaking Language Barriers: Cross-Lingual Continual Pre-Training at Scale Paper • 2407.02118 • Published Jul 2, 2024 • 1