Before revision:  Experiments on  machine translation and language modeling tasks show that DeLighT matches  the performance of baseline Transformers with significantly fewer parameters. On the WMT'14 En-Fr high resource dataset, DeLighT requires 1.8 times fewer parameters and 2 times fewer operations and achieves better performance (+0.4 BLEU score) than baseline transformers.
After revision:  Experiments on machine translation and language modeling tasks show that DeLighT matches the performance of baseline Transformers with 2 times fewer operations and achieves better performance (+0.4 BLEU score) than baseline transformers.