edited robots.txt, sitemap.txt