cleanup
add a dependency on tika
playing around with tika
ok, preprocessing I can deal with
small tokenizer fix
handle words that span over a line with a -