added a robots.txt as googlebot is causing a lot of exceptions in the
logs.