Adds robots.text in preparation for sitemap.