GitHub repository: msvrtan/centipede-crawler
Primary language: PHP
Description: Crawls all unique links.