GitHub repository: togethercomputer/RedPajama-Data
Primary language: Python
Description: The RedPajama-Data repository contains code for preparing large datasets for training large language models.