Ziya2: Data-centric Learning is All LLMs Need
Paper
•
2311.03301
•
Published
•
16
Data Efficiency
-
-
Memory Augmented Language Models through Mixture of Word Experts
Paper • 2311.10768 • Published • 16 -
TinyGSM: achieving >80% on GSM8k with small language models
Paper • 2312.09241 • Published • 33 -
Time is Encoded in the Weights of Finetuned Language Models
Paper • 2312.13401 • Published • 18 -
Data Engineering for Scaling Language Models to 128K Context
Paper • 2402.10171 • Published • 18 -
How to Train Data-Efficient LLMs
Paper • 2402.09668 • Published • 33