GitHub repository: malteos/llm-datasets
Primary language: Python
Description: A collection of datasets for language model pretraining including scripts for downloading, preprocesssing, and sampling.