Before revision:  This work considers distillation of BART and Pegasus , two state of the art  summarization models, on two datasets across a variety of student models.
After revision:  We compare these three approaches for distillation of Pegasus and BART, the current and former state of the art summarization models, on two datasets across a variety of student models.