adding robots.txt, site map and addition social sites