Before revision:  In this work, we propose a novel integer-only quantization scheme for Transformer based models that quantizes the entire inference process.
After revision:  In this work, we propose I-BERT, a novel quantization scheme for Transformer based models that quantizes the entire inference process.