GitHub repository: rom1504/cc2dataset
Primary language: Python
Description: Easily convert common crawl to a dataset of caption and document. Image/text Audio/text Video/text, ...