still analyze the tokens