Before revision:  We adopt the Bi-LSTM layers and a pre-trained BERT encoder respectively as its encoder module , and obtain promising results in a public English dataset as well as a Chinese one.
After revision:  We adopt the Bi-LSTM and the BERT as the encoder in our framework respectively , and obtain promising results in a public English dataset as well as a Chinese one.