added interface proposal for lexer
added proposed token specification
corrected javadoc