filling out lecture to be able to tokenize the two test files.

Also, Token now has a "TypeAsString" method which is just a gross switch statement. This is mostly for debug, though.
In addition, neat.cc has a sample of how one might use the Lexer class

Next step is to add more meta data to the token - most importantly, the value