GitHub repository: sanjusss/DotnetSpider
Primary language: C#
Description: DotnetSpider, a .NET Standard web crawling library similar to WebMagic and Scrapy. It is a lightweight ,efficient and fast high-level web crawling & scraping framework for .NET