Before revision: In this study we demonstrate the viability of deploying BERT-style models to AWS Lambda in a production environment . Since the freely available pre-trained models are too large to be deployed in this way, we utilize knowledge distillation and fine-tune the models on proprietary datasets for two real-world tasks: sentiment analysis and semantic textual similarity.
After revision: In this study we demonstrate the viability of deploying BERT-style models to AWS Lambda in a production setting . Since the freely available pre-trained models are too large to be deployed in this way, we utilize knowledge distillation and fine-tune the models on proprietary datasets for two real-world tasks: sentiment analysis and semantic textual similarity.