First pass at figuring out the web crawler.