Before revision:  We applied Weight Squeezing combined with Knowledge Distillation to a pre-trained text classification model , and compared it to various knowledge transfer and model compression methods on several downstream text classification tasks  .
After revision:  We applied Weight Squeezing combined with Knowledge Distillation to a pre-trained text classification model and compared our method to various other knowledge transfer and model compression methods on several downstream text classification tasks .