so ultimately they end up with like 32 squared length representation of their image and then they do one of two things they either do auto regressive generative pre-training which is the sort of GPT - style pre-training and the the idea here is that you always want to predict the next pixel of a sequence so you can see right here that's the sequence that you are sorry that's the sequence that you input and you always want to predict what is the next pixel and in this case you've seen you see that we've already predicted everything