smaller teacher network so say you originally trained the teacher network with like an efficient net and then you move it to a multi-layer perceptron because all it's doing now is adjusting the original distribution that was produced by this high capacity model so this high capacity model is already producing a pretty useful target distribution as in knowledge distillation and then the smaller teacher has enough capacity to be adapting it during training as in the meta learning framework the authors are going to test the performance of meta