GitHub repository: AmSmart/InfinityCrawler
Primary language: C#
Description: A simple but powerful web crawler library in C#