GitHub repository: jtatman/url-crawler
Description: Rust crate for configurable parallel web crawling, designed to crawl for content