 However, all-to-all attention severely hurts the scaling of the model to large sequences. Another limitation is that information about the context is stored  in the same element-wise representations.
<coherence>  However, all-to-all attention severely hurts the scaling of the model to large sequences. Another limitation is that information about the context is stored  in the same element-wise representations.
 However, information about the context is stored in the same element-wise representations.