When we think of the English term “attention,” we think of focusing your attention and paying closer attention to something. Deep Learning’s Attention mechanism is built on the idea of directing your attention, and it pays more attention to particular criteria when processing data.