merging tokenizing and parsing