Minor cleanups.
Set newline flag if a token is preceded by a line terminator.
Add [no line-terminator here] flag handling in lexer.

Return a semicolon if a newline is encountered with the [nlth]-flag set.