Implement basic crawl functionality without Redis in order to prevent freezing
Optimize crawler
Connect crawler to database
Add masterCrawler
Merge branch 'experimental' into develop