github.com/xujiajun/gotokenizer (go): A tokenizer based on the dictionary and Bigram language models for Go. (Now only support chinese segmentation)
Keywords: golang|segmentation|tokenizer