and both or can be understood as kind of a language modeling one so language modeling for those you don't know is predict the next word in a sequence so if I give you the sequence here unsupervised representation learning has been and then ask you what's next and then you're supposed to say highly right those language modeling in in a nutshell so what they what they differentiate are two kinds of language modeling the first one they say is order aggressive language modeling now what auto regressive language modeling does is exactly what we've