The original indexing code

For backup only.
This is almost exactly indentical to the IndexFile demo included in
lucene 4.0.
NGramTokenizer redone

Tokenizer is now based on NGramTokenizer of lucene and it creates index
of sensible size.