tokenizer returns valid tokens to scanner