MOD LucenebasedTokenzier, add unit test