doc annotator that can concatenate hyphenated tokens if they represent a single word

This doc annotator works on the output of the tokenizer and concatenates tokens if based on a user-provided dictionary or based on other tokens from the same document. 
It modifies the tokens so any other attrs on the tokens may be lost if tokens are concatenated.