Before revision:  In this paper, we propose a novel training method that enables pretrained contextual embeddings such as BERT to process acoustic features.
After revision:  In this paper, we propose a novel training method that enables pretrained contextual embeddings to process acoustic features.