GitHub repository: 1333907/cloud-crawler
Primary language: Java
Description: cloud-crawler is a distributed crawler developed on the basis of crawler4j.