Wrap Crawl() function within a Crawler object

This object will hold local configuration like the root URL that's
been configured for the crawler and other future (early) discarding
configuration options that we're likely to use.