token production seems to be successful, with bugs still being present for the EOF. also, comment functionality still needs implementation