Fix `#if 0` w.r.t. string embeddings and regexes

Lexing false #if sections as comments using `tokens` requires an
inconvenient number of states to keep track of things, since not every
line-initial `#endif` is really a preprocessor directive. This commit
uses `get_tokens_unprocessed`, which is more forwards-compatible in case
strings change.