skeleton code and assignment details
Authors
created tokenizer object
accounting for escape chars and working on get next token
Successfully created tokenizer object
Considered case where token is not delim
Work in progress. Encountering issues with inserting tokens into the buffer
tokenization now working. Escape chars in progress