robot.txt, sitemap.xml, minor updates