fix problem with tokenizing last token: should return a list of (lookup) of the lexemes for that token.
useful for debugging
fix analysis of morphology of nouns and adjectives