brittainmedia/phpcrawl (packagist): PHPCrawl is a webcrawler/webspider-library written in PHP. It supports filters, limiters, cookie-handling, robots.txt-handling, multiprocessing and much more.
Keywords: crawl|crawler|php|php74|sphider