GitHub repository: zhenghh04/blendcorpus
Primary language: Python
Description: BlendCorpus is a modular and scalable data preprocessing and loading framework for large language model (LLM) training.