Added comments to test file
Added a type for C tokens
Removed quotes and apostrophes from token set
open Lexer