add SCHEDULER_IDLE_BEFORE_CLOSE to prevent the spider from being closed when distributed crawling
Merge pull request #9 from MOON-CLJ/master

add SCHEDULER_IDLE_BEFORE_CLOSE to prevent the spider from being closed when distributed crawling