GitHub repository: malteos/lm-datasets
Primary language: Python
Created: 2023-09-19T09:09:43Z
Description: A collection of datasets for language model pretraining including scripts for downloading, preprocesssing, and sampling.