Change scoring strategy
Generalize directory to be compatible with lucene's general directory model, move some more methods into AbstractTagger