GitHub repository: mplelis/web-crawler-java
Primary language: Java
Created: 2017-11-25T19:22:01Z
Description: The concurrent web crawler, crawls URLs and for each page, it determines the URLs of every static asset (images, javascript, stylesheets) on that page and prints this data in JSON format.