Before revision: BERT has emerged as a popular model for natural language understanding. Given its compute intensive nature, even for inference, many recent studies have considered optimization of two important performance characteristics: model size and inference time. We consider classification tasks and propose a novel method, called PoWER-BERT, for improving the inference time for the BERT model without significant loss in the accuracy.
After revision: We develop a novel method, called PoWER-BERT, for improving the inference time for the BERT model without significant loss in the accuracy.