Self-attention lets the encoder pay attention to multiple inputs in parallel while it decodes them for faster results.