Added robots, sitemap and updated site configuration