Expectations about token type
Space and comment
Scanning identifiers

This includes code that is likely not necessary.  The escape sequence scanning will likely not be used in our case, but I'm committing it here so it can be brought back if needed later.
Escape sequences in our identifiers have already been handled
Scan string literals
Skip whitespace