Before revision:  Moreover, via  analysis of generated sequences, we find that UID-regularized language models are higher-entropy and produce text that is longer and more lexically diverse.
After revision:  Moreover, via analysis of generated sequences, we find that UID-regularized language models have other desirable properties, e.g., they generate text that is longer and more lexically diverse.