[driver,lexer,parser] add possibility to show intermediate results

remove tests from driver and lexer, showing tokens and AST allows easier testing of changes