added robots.txt and sitemap.xml generation