DotnetSpider (nuget): DotnetSpider, a .NET Standard web crawling library. It is lightweight, efficient and fast high-level web crawling & scraping framework
Keywords: DotnetSpider|crawler|dotnet|core|cross-platform|csharp|distributed|dotnetcore