icetk (pypi): A unified tokenization tool for Images, Chinese and English.
Keywords: tokenization|transformer