Before revision:  Could we operationalize uniform information density as an inductive bias for statistical language modeling ? In this paper , we augment the canonical MLE objective for training language models by encoding UIDas regularization .
After revision:  Could we operationalize uniform information density as an inductive bias for statistical language modeling . Specifically , we augment the canonical MLE objective for training language models by encoding UIDas regularization .