codeguy/arachnid (packagist): A crawler to find all unique internal pages on a given website
Keywords: search|spider|scrape|crawl|crawler|php|scraping|seo