building out token basics
refactoring to group up common defines
some simple lexing