Webcrawler that runs over Hadoop Cluster using mapreduce framework.