Finished tokenization - able to build token stream.