learn static position embeddings that you then can attend to with your queries all right so these are the position embeddings and they make use of those position embeddings in fact they attend them to the following in this work we enable the output to retrieve relative positions beside the content based on query key affinities formally so the problem up here is that okay you have these position embeddings um and here are the outputs but if you do this in multiple layers right if you do let's let's go with 1d