lucene 4.6.0 fixing tests and tokenizers to comply with tokenstream API