GitHub repository: tomasnorre/crawler
Primary language: PHP
Description: Libraries and scripts for crawling the TYPO3 page tree. Used for re-caching, re-indexing, publishing applications etc.