give an error when a crawled link gives an error status code
Merge pull request #9 from forkfork/flag-error-on-crawled-link

give an error when a crawled link gives an error status code