GitHub repository: sangmichaelxie/doremi
Primary language: Python
Created: 2023-05-25T01:55:08Z
Description: Pytorch implementation of DoReMi, a method for optimizing the data mixture weights in language modeling datasets