Correct mispeling in robots.txt, add a few more disallowed lines.