Before revision:  Experiments on 10 language pairs show that removing the embedding matrix consistently improves the performance of byte-to-byte models , often outperforms character-to-character models , and sometimes even produces better translations than standard subword models .
After revision:  Experiments on 10 language pairs show that removing the embedding matrix consistently improves the performance of byte-to-byte models in particular .