tokenizer->numTokens is correct now