GitHub repository: umpirsky/centipede-crawler
Primary language: PHP
Description: Crawls all unique links.