final one before the break is kind of you could think of it as pretty much in the same vein as Elmo and what we did instead is we took a better language model again so transformers came out and we were really excited by their ability to handle longer range dependencies and they were also very computer efficient so you you could train them quite well and quite fast so we swap out the recurrent network or the LS TM in the language model for a transformer based language model and if we want we could talk a bit about a self attention and