Before revision:  BLM can be efficiently trained using a lower bound of the marginal data likelihood , and achieves perplexity comparable to traditional left-to-right language models on the Penn Treebank and WikiText datasets .
After revision:  BLM can be efficiently trained using a lower bound of the marginal data likelihood .