Sweeeeeet stuff happened!!! Initial commit for celery + rabbitmq server
Adding initial celcery tests, adding to requirements list
Initial spider crawl task, more tests
Try to run crawl via code
Making headway into crawler_server and simple monitor
Adding cancelspider task, rearranging crawler specific views&urls
Changing miner to class, adding pagerank and webometric analyses and tests.
Changing mine task into celery task coz of massive computation
removing unused import
Updating requirements file
small test tweak
Add stats miners for webometrics, pagerank and history