here we've already predicted everything up to this red pixel so you want to know what's this next pixel this thing right here what's this going to be and the diagram here basically shows you how the attention flow so every position in this transformer and if you don't know what a transformer is I haven't made a video about attention is all you need where these are explained but briefly every position here can sort of send information can send information only in one direction as to so you train all of these in parallel and when you predict