GitHub repository: paranshu-singhal/jsoup-crawler
Primary language: Java
Created: 2020-02-08T03:59:20Z
Description: This code scans the document for hyperlinks and then crawls those links. It maintains list of hashcodes of URLs traversed so it does not re-traverse the links again. Not really efficient but does the job of collecting data.