added another version of initGeneralTokenizer

added a version of initGeneralTokenizer that accepts a cstring instead of a string. Also made the old version use this function in its implementation.

I use this when calling the highlighter from C#.