Update robots.txt, remove error reporting.