Before revision:  The self-attention architecture allows us to combine information from all elements of a sequence into context-aware representations.
After revision:  The self-attention architecture allows transformer to combine information from all elements of a sequence into context-aware representations.