Added robots and sitemap.