iamtokenizing (pypi): Simple tokenizers: n-grams and chargrams splitting, white space splitting, or splitting using configurable REGEX expression, or detection into context tokenization. Based on ExtractionString object from the extractionstring package.
Keywords: bigram|chargrams|natural language processing|ngrams|nlp|regex|string|token