add robots.txt and change paths