Java Web Crawler

Baisc Web cralwer. One can add duplicate detection by having simple
hash() (for exact copy detection, which is rarely useful) or some other
advanced technique of finding similar pages like Jacard Coefficient for
similarity.