there is nothing special about this being an axis or whatnot you could also define and it would not be called axial attention but you could define it it makes the same sense to say well that green pixel just depends on this diagonal right here just in the in this layer it just does this diagonal and then in the next layer it does like the anti-diagonal um you can say uh i just choose five random pixels in this layer and five random pixels in the next layer and that would work as well we've already seen this in this paper called