Finished preliminary tokenizer