pull scrapy from github (0.20.2 misses some features)
add link extraction for parsing all pages
adding item loader parsing
make db fail gracefully if redis isn't started
last bits to get crawler working
fix deployment
typo
regex update
update the frontend