Added functionality to return robots.txt and sitemap.xml