 Then , we propose  a novel knowledge distillation framework for knowledge graph embedding, utilizing multiple low-dimensional  KGE models as teachers  . Under a novel iterative distillation strategy, the MulDE modelproduces soft labels according to training epochs and student performance adaptively .
<meaning-changed>  Then , we propose  a novel knowledge distillation framework for knowledge graph embedding, utilizing multiple low-dimensional  KGE models as teachers  . Under a novel iterative distillation strategy, the MulDE modelproduces soft labels according to training epochs and student performance adaptively .
 Then , we propose a novel knowledge distillation framework for knowledge graph embedding, utilizing multiple low-dimensional KGE models as teachers . Under a novel iterative distillation strategy, the Junior component, a low-dimensional KGE model, asks teachers actively based on its preliminary prediction results, and the Senior component integrates teachers' knowledge adaptively to train the Junior component based on two mechanisms: relation-specific scaling and contrast attention .