added robots.txt etc & sitemap.xml