GitHub repository: wisesight/newmm-tokenizer
Primary language: Python
Created: 2020-10-26T03:10:42Z
Description: Standalone Dictionary-based, Maximum Matching + Thai Character Cluster (newmm) tokenizer extracted from PyThaiNLP