GitHub repository: CrazyForks/Crawl4LLM
Description: Official repository for "Crawl4LLM: Efficient Web Crawling for LLM Pretraining"