fixed up robots.txt and sitemap.xml and mods to config