add robots.txt and minor changes to page