Before revision:  The proposed method is inspired by the excellent sequence modeling capability of bi-directional encoder representation from transformers (BERT).
After revision:  The proposed method is inspired by the excellent sequence modeling capability of bidirectional encoder representation from transformers (BERT).