GitHub repository: mingruimingrui/ICU-tokenizer
Primary language: Python
Created: 2020-05-21T18:27:50Z
Description: ICU based universal language tokenizer