_TokenStream: Handle EOF even if it occurs while reading an identifier

Without this fix, the tokenizer can get stuck in an infinite loop.

Reported-by: Linas Vepstas <linasvepstas@gmail.com>