Added License
Merge branch 'master' of bitbucket.org:sdbrain/dirindexer
Added tokenizer to tokenize by space and case insensitive
Merge branch 'master' of bitbucket.org:sdbrain/dirindexer
Documented class and init, fixed tabs and reduced imports
Improved code formatting