More improvement
Adding data structures for more efficient crawling. In particular I added Seen which will contain URLs that are discovered so that duplicates url are not downloaded again and again