Top site crawling tools are Screaming Frog SEO Spider, Apify,  DeepCrawl, WildShark, Scraper, and OnCrawl. 80legs and Dyno Mapper are web based site crawling tools that run web crawls through SaaS.