Update crawler.js

Add referer to request. Useful to found 404 referer for exemple.
Merge pull request #92 from alexandregaltier/patch-1

Added referrer value to headers, derived from queue.