use lucene token stream properly