updated robots.txt and added sitemap.xml