Fixed a bug where the character immediately following a token is stripped.