Before revision:  Moreover, via  analysis of generated sequences, we find that UID-regularized language models are higher-entropy and produce text that is longer and more lexically diverse.
After revision:  Moreover, via analysis of generated sequences, we find that UID-regularized language models are higher-entropy and produce text that is more lexically diverse.