NaturalNode/natural — pull request #55 by gmarty (2012-08-23 07:23:47+00:00)
Title: Tokenizer and misc

This PR contains:
* A Japanese tokenizer
* A list of Japanese stop words
* A basic Japanese stemmer
* A better normalizer
* Plenty of tests

A few portion of code is taken from external project. I carefully checked and license were compatible with natural. I included original licenses and locations.