better if I had said we're trying to predict these two words is and a right and once I predict so so Bert would actually have access to the word City here whereas the auto regressive models only have access to the ones before it I hope that makes it clearer so the main idea in excel net is where did where does this order dependence come in the autoregressive model the order dependence actually comes from the factorization of the sentence of the of the language model so in a language model we're actually trying to assess