Before revision:  Our EBR consistently improves the performance of the Transformer-based NMT: + 3 BLEU points on Sinhala-English , + 2.0 BLEU points on IWSLT'17 French-English, and + 1.7 BLEU points on WMT' 19 German-English tasks.
After revision:  We use both marginal energy models (over target sentence) and joint energy models (over both source and target sentences). Our EBR with the joint energy model consistently improves the performance of the Transformer-based NMT: + 3 BLEU points on Sinhala-English , + 2.0 BLEU points on IWSLT'17 French-English, and + 1.7 BLEU points on WMT' 19 German-English tasks.