Change crawl functions to allow options argument to be optional
Add crawl.all and crawl.all.metadata functions