Initial spider crawl task, more tests
Try to run crawl via code
Making headway into crawler_server and simple monitor
Adding cancelspider task, rearranging crawler specific views&urls
Changing miner to class, adding pagerank and webometric analyses and tests.
Changing mine task into celery task coz of massive computation
removing unused import