tokenize: support mode

Ngram tokenizer splits with different rules by ``GRN_TOKEN_GET``/``GRN_TOKEN_ADD`` mode.
I want to debug the different modes in the tokenize command.