It mostly pretends to do so, by using context windows. Basically, the whole conversation is processed again at each iteration, so that the model has access to the whole context.​