fixed bugs in tokenizer; converting all output into lowercase
added additional analysis result, fixed bugs in lexicon