Small tweak around the internals of tokenizeString.