latin-language-toolkit/llt-tokenizer — pull request #24 by lichtr (2014-06-17 14:28:02+00:00)
Title: Greek tok

Add a basic tool for Greek tokenization. This PR handles a krasis by splitting it into two tokens without restoring their standard value such as κἄγω would return κ- and ἄγω.