add the robot.txt to the html.