Before revision:  In this work, we re-examine the trade-off and argue that transformer-based autoregressive models can be substantially sped up without loss in accuracy.
After revision:  In this work, we re-examine the trade-off and argue that autoregressive baselines can be substantially sped up without loss in accuracy.