vocabulary one for gender one for kent's whatever it is right whatever the thing needs to it can look at different parts of the input document for different purposes and do this at each layer right so you can kind of intuitively see how this would be a really flexible mechanism for for processing a document or any sequence okay so that is when the key things that enables the transfer model that's the multi-headed attention part of it now let's look down here at the positional encoding which is which is critical and novel in a