Project 1 in Compiler construction. Processes an input stream into defined tokens