though in practice the teacher network is gonna be a multi-layer perceptron like this but the student network is one of these high capacity classification models like ResNet wide ResNet or efficient that so the idea is you want to say update this weight from the input to a hidden state in the teacher network and you're gonna try to take the partial derivative with respect to this way in the teacher network with respect to the validation loss on the the student network after at theta t plus 1 on that validation set so this is trained with