Implementation of sitemap discovery code.