Before revision:  The model aggregates encoded speech features into the hidden representations corresponding to each token with attention mechanisms. Thus, the model can capture the token relations by self-attention on the aggregated hidden representations from the whole speechsignal rather than autoregressive modeling on tokens .
After revision:  The model consists of an encoder, a decoder, and a position dependent summarizer (PDS). The three modules are based on basic attention blocks. The encoder extracts high-level representations from the whole speechsignal rather than autoregressive modeling on tokens .