Add robots and sitemap files.