Add fail delay to SiteCrawler

* Add option fail delay