Before revision: The field of language modelling has been largely dominated by autoregressive models , for which sampling is inherently difficult to parallelize .
After revision: Generative flows and diffusion models have been predominantly trained on ordinal data, for example natural images .