Implemented Tokenizer Logic.