Before revision:  Recent work on distilling BERT for classification and regression tasks shows strong performance using standard knowledge distillation.
After revision:  Recent work on distilling BERT for classification and regression tasks shows strong performance using direct knowledge distillation.