added function to get token and gave it the ability to recognize identifiers