be learned and hard coded but they still are modified by the queries so the query can still pay attention the difference is the keys depend on the input while the positional encoding does not depend on the input so the queries can decide i want to gather information from this and this and this type of information so that would be the key or it can decide i would like very much to look at pixels that are somehow on the bottom right of the pixel that i am now that would be the um positional encodings and that's that's the mistake