Minor changes.
Merge pull request #5 from masaruh/fix-features

Fixed an issue that TokenInfoDictionary doesn't return all features.
Updated changes and fixed test imports.
Adding Bocchan tests for IPADIC including all token features
Fixing broken Viterbi path bug, improving disk usage, adding tests.

- added inserted node for holes in Viterbi graph
- compaction of DoubleArrayTrie for less memory footprint
- separated part-of-speech into separate data structure for memory improvements
- fixed user dictionary bug
- improved test coverage
Updated CHANGES log
Fixing UniDic POS bug, adding BufferedInputStream to ConnectionCosts
Improved performance

- Compacted duplicated fields in TokenInfoDictionary
- Added buffering to input streams for faster loading of files
UserDictionary fix, tokens with whitespace now allowed, minor DoubleArrayTrie refactoring
Refactoring kuromoji to support sub modules.
Adding the following modules.

- kuromoji-common
- kuromoji-ipadic
Major refactoring, gains in performance, adding support for new dictionaries

- Tokenizer can now be run without a TokenizerRunner
- support for unidic with accents in kuromoji-unidic-extended module
- support for naist-jdic in kuromoji-naist-jdic module
- improved performance for writing and reading connection costs
- compation of tries added as argument to DictionaryBuilder
Use unzip task instead of untar
Add option to discard non-normalized entries in DictionaryBuilder.  Other minor improvements.
Fixed email address
Added preliminary Korean language support. Other minor improvements.
Added mecab-ko dictionary formatter and some work-in-progress test code