Question: What evidence does visualizing the attention give to show that it helps to obtain a more robust understanding of semantics and sentiments?
Answer: The different attention distributions suggest that the proposed senti-emoji embedding is capable of recognizing words with strong sentiments that are closely related to the true sentiment even with the presence of words with conflicting sentiments