Before revision:  In this work, we criticise NMT models probabilistically showing that stochastic samples following the model's own generative story do reproduce various statistics of the training data well, but that it is beam search that strays from such statistics.
After revision:  In this work, we show that translation distributions do reproduce various statistics of the training data well, but that it is beam search that strays from such statistics.