Add robots.txt and sitemap.xml.