modified crawler.js
trying to add: continue downloading the failed links