and you can pre train the word vectors that's all really nice but people have realized ok words kind of multiple meanings and words can kind of slightly change meaning depending on words around them and so on so what Elmo does is Elmo uses to Alice Tian's one Elliston goes into this direction when I Austin goes into this direction and basically a single lsdm as we saw the four it takes in the input sequence one by one so here e1 and e2 if the en it produces hidden states at each step produces a hidden state that