The ReaderCharStream handled purely ASCII characters. JavaCharStream can parse unicode in UTF-8 form /u....
The Javacc parser file has been changed and upgraded to Javacc 5 to support unicode. It also handles a class of bugs which led to the parser falling into an infinite loop. Double byte unicode chars not supported yet. Will be supported when parser gets upgraded to Javacc 6.
The files produced by Javacc 5 using the TermParser.jj file. The generated files support unicode conforming to unicode consortium. Can upgrade to Javacc 6 when required.