added the Moses tokenizer
dict hit rate included that runs on all of europarl