Before revision:  The Perceiver obtains performance comparable to ResNet-50  on ImageNet without convolutions and by directly attending to 50,000 pixels.
After revision:  The Perceiver obtains performance comparable to ResNet-50 on ImageNet without 2D convolutions by directly attending to 50,000 pixels.