ambs/text-ngram — pull request #1 by gray (2012-01-22 05:22:43+00:00)
Title: xs now handles utf-8

Changes:

* Fixed off-by-one error.
* Sped up UTF-8 processing; now uses XS instead of pure perl.
* Allowed config to be passed in as named arguments.
* Prevented compilation warnings.

TODO:

* Most of the time is now spent in _clean_buffer, so convert it to XS.
* Determine if splitting string is better approach than using substitution to insert placehold character and filtering them out later.