Making tests work
Added custom TestCase with inbuilt set_trace, got green on stats tests
Adding test for mine_data exception
Got green tests for johnnywalker and the whole project
Adding failing test for link extraction and cleanup
Adding restapi
Adding tastypie, introducing api to all apps, but urls not working
Adding shell file to clean project folder, adding save mine_data
clean.sh shall remove all generated output
save method in mine_data saves stats to database
Adding scrapyd to management commands
Scrapyd server now started using 'scrapyd' command and redundant johnnywalker/startserver removed
Reducing arguments given to scrapy mgmt command
User now required to enter only start and domain arguments instead of the whole scrapy command
Dummy proofing scrapy command
Alot model changes
Updating models with '__unicode__' field, creating migrations for stats,webui apps
Correctly configured scrapy signals
Stats generation now triggered after scraping is done
Adding jobid field in walker to prepare for server deployment
Updating the crawler api
Adding deploy to scrapy command
Project can now be deployed using 'scrapy deploy' command
Configuring api resources and urls
RestAPI now operational though not implemented
Converting resultsresource to modelresource
Adding RestAPI stuff to crawler api, configuring tastypie settings