Added celery to requirements.txt
Added celery to requirements.txt
celery example
celary example fixed
celary instruction
Merge commit
[WIP] Parser & crawler
Ended parser & crawler - not tested due to issue with celery
celery working on project level, crawl_and_parse can crawl
Crawler won't create the same domains and webpages more than once
Added crawled pages counter into log and cache.