Bug 906882 - Create a dynamic XML sitemap of top-level URLs in [Bedrock]

Each URL pattern has the `meta_robots` argument to prevent the URL to be listed on the sitemap. This argument might also be used to set a meta robots tag in the page source.