Addings robots.txt
Adding url to config
Adding sitemap
Adding sitemap to robots.txt