processor.web: Catch errors during fetching robots.txt

Closes chfoo/wpull#185
gitignore: Ignore Intellij and .orig files