Before revision:  We applied Weight Squeezing combined with Knowledge Distillation to a pre-trained text classification model , and compared it to various knowledge transfer and model compression methods on several downstream text classification tasks  .
After revision:  We applied Weight Squeezing combined with Knowledge Distillation to a pre-trained text classification model , and compared it to various knowledge transfer and model compression methods on several downstream text classification tasks based on the GLUE dataset .