Option to skip delimiters in CDelimiterTokenizer
Merge pull request #1217 from van51/feature/tokenizer

Option to skip delimiters in CDelimiterTokenizer