it doesn't matter to the machine so it's like the problems a feed forward network has so we need to annotate it we have to give it positional information and learned positional information seems to work very well right here though you could think of static positional information okay this is the first thing the positional embeddings um that now help the attention mechanism see where the information is coming from that's really important in pictures uh so we add that the second thing they do is this so-called axial