Changed CDelimiterTokenizer behavior on consecutive delimiters
Merge pull request #1209 from van51/feature/hashing

Changed CDelimiterTokenizer behavior on consecutive delimiters