Before revision:  In this paper , we augment the canonical MLE objective for training language models by encoding UIDas regularization .
After revision:  In this paper , we augment the canonical MLE objective for training language models with a regularizer that encodes UID .