more idiomatic return values from functions, eliminated sitemap field of type Crawler