#tokenize already returns ast, comments and tokens distinctly.