pretok (cargo): A string pre-tokenizer for C-like syntaxes.
Keywords: text|tokenizer|lexer|lexical-analysis|text-processing|tokenization