scanner: tag tokens with token type flag.

To handle the situation where a string literal "(" is used, we
needed to enhance the scanner to also provide the type of the
token passed to the parser. Now strings containing LISP are OK.