the input to the model instead of the word vector representation so kind of seeing all those early results like skip thought vector showing that well you could learn and distribute representation of the sentence this one does it but it does it at a word level and it just cleanly slots in where word vectors used to go and so what this is quite nice by is it allows you to have very direct comparisons with prior work and across the board they basically show that like simple baseline models which substituted to use these representations