Removed dependence on inferior internal settings and used scrapy
settings mechanism instead
Revamped the architecture of the API
Added url list crawled and single page crawler
Now the project settings is read from SCRAPY_SETTINGS_MODULE
Added user-customizable item filtering
Added an option, SCRAPY_MANAGE_REACTOR, that allows users to start and
shutdown the twisted reactor themselves
Now ScrapyPageListCrawler doesn't need to instantiate it's generator
more than once
Removed PySide usage from data.py
Fixed an attribute error in the settings
Added some useful Scrapy middlewares from the internet
Added stem to requirements.txt to control tor, when the appropriate
middleware is enabled
Added some user agents that will be randomized through when the
appropriate middleware is enabled
Removed spider_stop_signal from IEventHandler
Tor circuit refreshed only when connection is refused
Now download_delay is handled correctly
Added scraping multiple items per page capability
Used scrapy log
Merged wlw_branch with master