Initial commit
configuration file parsing
added flag for output dir
Basic crawling functionality finished
refectored crawling logic
skip unwanted words from the text
added dependecy script
Merge branch 'master' of github.com:varnamproject/crawler