Before revision:  We consider classification tasks and propose a novel method, called PoWER-BERT, for improving the inference time for the BERT model without significant loss in the accuracy.
After revision:  We consider classification tasks and propose a novel method, called PoWER-BERT, for improving the inference time of the popular BERT model, while maintaining the accuracy.