added some basic infrastructure and comments on what to do

the algorithm in Crawler.java is taken from lecture-7-crawling.pdf
added some infrastructure

added algorithm as comment - taken from lecture-7-crawling.pdf
Merge remote-tracking branch 'origin/master'