added stateCallback for exposing lexer state

 hidden under -D expose_lexer_state