fix spidering getting stuck bug
Merge branch 'master' of git@github.com:gigablast/open-source-search-engine