togethercomputer/redpajama-data: The RedPajama-Data repository contains code for preparing large datasets for training large language models.
Category: llm
Language: Python