Added an option, SCRAPY_MANAGE_REACTOR, that allows users to start and
shutdown the twisted reactor themselves
Now ScrapyPageListCrawler doesn't need to instantiate it's generator
more than once