large corpus and we're gonna see how that's done all right so the paper introduces basically the kind of current state of the art of language models and they say okay what they want to do new is they want to do bi-directional training I'm going to go down here and see their comparison right so here they compare three models and these are representative of three types of models so first here is for example the the open AI transformer so this is a this is the classic or one of the classic transformer models we've talked