Added specs for double-byte characters.
Fixed bug where unique token could be prefixed with delimiter.

- Only happened in cases where there was nothing to tokenize.
- Now, if unique and there is nothing to tokenize, only the unique hex
  token will be used.