Before revision:  Moreover, via  analysis of generated sequences, we find that UID-regularized language models are higher-entropy and produce text that is longer and more lexically diverse.
After revision:  Moreover, via an analysis of generated sequences, we find that UID-regularized language models are higher-entropy and produce text that is longer and more lexically diverse.