Add diagnostic formatting for lexerTokens.
Restrict TEXTDATA to printable ASCII characters.