I imlemented a large portion of the crawling part of the crawler