Question: How do they measure which words are under-translated by NMT models?
Answer: They measured the under-translated words with low word importance score as calculated by Attribution.
method
Alternative answer: we ask ten human annotators to manually label the under-translated input words, and at least two annotators label each input-hypothesis pair