Before revision: State-of-the-art neural machine translation models generate outputs autoregressively, where every step conditions on the previously generated tokens. This sequentialnature causes inherent decoding latency.
After revision: State-of-the-art neural machine translation , which appears to be an efficient alternative to state-of-the-art autoregressive machine translation on modern GPUs. In contrast to the latter where generation is sequential, the former allows generation to be parallelized across target token positions.