RegMix: Data Mixture as Regression for Language Model Pre-training
Paper
•
2407.01492
•
Published
•
38
•
7
Xiaosen Zheng
xszheng2020
AI & ML interests
Data-Centric AI and AI Safety.
Recent Activity
liked
a dataset
1 day ago
BytedTsinghua-SIA/DAPO-Math-17k
liked
a dataset
1 day ago
AI-MO/NuminaMath-CoT
liked
a model
9 days ago
lkevinzc/Llama-3.2-3B-NuminaQA
Organizations
xszheng2020's activity
commented
a
paper
8 months ago