Before revision:  However, all-to-all attention severely hurts the scaling of the model to large sequences. Another limitation is that information about the context is stored  in the same element-wise representations.
After revision:  However, information about the context is stored in the same element-wise representations.