GitHub repository: tanyonghe/cortex-crawler
Description: Cortex Crawler is a high-performance, multithreaded web crawler built in Java. It features domain-aware rate limiting, a priority-based URL scheduler, and thread-safe crawling powered by Java's concurrency libraries.