RegMix: Data Mixture as Regression for Language Model Pre-training
Paper
•
2407.01492
•
Published
•
34
•
7
Xiaosen Zheng
xszheng2020
AI & ML interests
Data-Centric AI and AI Safety.
Organizations
xszheng2020's activity
commented
a
paper
3 months ago