tokenizers-collection (pypi): A simple iterator for using a set of Chinese tokenizer
Keywords: tokenizers_collection