* running cons-prod pattern as threads
* trying to make a shutdown hook to serialize crawling state
Merge remote-tracking branch 'origin/master'