Modified crawler to store into failed and retrieving
Merge branch 'master' of https://github.com/vharnath/crawler