Added a token list class to simplify processing and testing. Added unit tests to help verify that the TestBufferState is acutally picking up the tokens.