added visted method to end crawl so we don't crawl already cralwed pages