Before revision:  We prove , from a theoretical perspective , that under reasonable conditions MixKD gives rise to a smaller gap between the generalization error and the empirical error.
After revision:  We prove , from a theoretical perspective that under reasonable conditions MixKD gives rise to a smaller gap between the generalization error and the empirical error.