Tokenizer basic loop.