No more exceptions because google can't find robots.txt

Looks like feature/errbit is what's deployed right on heroku now - I deployed this fix there, but I don't commit access on github, so here's a PR.