Before revision:  On the WMT'14 En-Fr high resource dataset, DeLighT requires 1.8 times fewer parameters and 2 times fewer operations and achieves better performance (+0.4 BLEU score) than baseline transformers. On the WMT'16 En-Ro low resource dataset, DeLighT delivers similar performance with 2.8 times fewer parameters than baseline transformers.
After revision:  On the WMT'14 En-Fr high resource dataset, DeLighT requires 1.8 times fewer parameters and 2 to 3 times fewer parameters on average. Our source code is available at: URL