crawls on initial page, goes to ~/crawl/site/index