Tokenizer is finished, passes all fundamental tests.