Added a token enumerator for the AST generator