first tests added for Tokenizer.
Merge branch 'master' of https://github.com/croo/IR-Porject