.gitignore updated: robots.txt added, sitemapgenerator specific config removed.