give an error when a crawled link gives an error status code

@TabDigital/api 

This will make the smoke tests fail when we bump the npm version until https://github.com/TabDigital/api-smoke-tests/pull/27 is merged.