added #directive lexing. added line+char pos tracking to tokens. minor tweaks