remove robots.txt closes #542