web crawler

WebCrawler for collecting relevant url test set for different websites i.e. amazon.com, walmart.com, target.com and newegg.com.