GitHub repository: mvolikas/incubator-stormcrawler
Primary language: Java
Description: A scalable, mature and versatile web crawler based on Apache Storm