Implemented Tokenizer to spec.