Before revision:  To that end, we omit the input and output embeddings from a standard machine translation model, and represent text as a sequence of bytes via UTF-8 encoding, using a constant 256-dimension one-hot representation for each byte. Experiments on 10 language pairs show that removing the embedding matrix consistently improves the performance of byte-to-byte models , often outperforms character-to-character models , and sometimes even produces better translations than standard subword models .
After revision:  To that end, we omit the input and output embeddings from a standard machine translation model, and represent text as a sequence of bytes via UTF-8 encoding, using a constant 256-dimension one-hot representations of each byte does not hurt performance; experiments on byte-to-byte machine translation from English to 10 language pairs show that removing the embedding matrix consistently improves the performance of byte-to-byte models , often outperforms character-to-character models , and sometimes even produces better translations than standard subword models .