Add mongo backed httpcache storage
Added README and setup.py files.
Added new scmongo.util.get_database() function.

Which provides enviroment variables as an alternative way to (to Scrapy
settings) for getting the Mongo configuration details.
Changed MongoCacheStorage to use GridFS (better suited for response payload), and updated README
Minor improvement to README layout
Yet more updates to README
Fixed bug in scmongo.util getting the BOT_NAME, and rearranged code layout
initial commit
updated imports after scrapy changes
fixed import
MongoCacheStorage: use single mongo collection instead of one per spider
All in baby
Signed-off-by: Balthazar Rouberol <rouberol.b@gmail.com>
Better pipeline name
Signed-off-by: Balthazar Rouberol <rouberol.b@gmail.com>
Tor change proxy middleware
MySQL pipelines from snippets.scrapy.org
MongoDBStorage pipeline

extracted from git://github.com/BaltoRouberol/isbullshit-crawler.git
mongo pipeline
Merge mongo pipelines