Question: How do their models decide how much improtance to give to the output words?
Answer: Given the contribution matrix, we can obtain the word importance of each input word to the entire output sentence. 
Alternative answer: They compute the gradient of the output at each time step with respect to the input words to decide the importance.