stays the same size but the the recurrent model will update the hidden state as it goes over the input sequence so this is one way of dealing with language but people have kind of done another way and that's the attention based mechanism is where basically for each of these you compute a compute a vector independently of each other so each one has a vector representation and then you have a vector representation of what you of what you want which is called an attention head and you can have multiple of these but in the