GitHub repository: nccreal/DotnetSpider
Primary language: C#
Description: DotnetSpider, a .NET standard web crawling library. It is lightweight, efficient and fast high-level web crawling & scraping framework