Add lexing of preprocessor directives.
Some preliminaries for adding a preprocessor.
Minor simplification of next_code_points() in the lexer.
Add a stub preprocessor and some related fixes/adjustments.