Allow the tokenizer and corpora-to-dr binaries to accept multiple input
files.
More tokenization tweaks.
Allow tokenization iterator null deref to cause issues.