replaced unrecognized tokens in regexps with utf-8 characters.
other fixes are being debugged.
continue debugging
fixed bugs for pre-parsing normalization.