GitHub repository: tryingfox/webmagic
Primary language: Java
Description: A scalable web crawler framework.