tokenize-string is functional, but still sensitive to missing whitespace