add revised robots.txt and sitemap.xml