Question: What useful information does attention capture?
Answer: it captures other information rather than only the translational equivalent in the case of verbs
Alternative answer: Alignment points of the POS tags.