Before revision:  Bi-LSTM relieves the vanishing gradient problem, and attentional mechanisms allows learning and interpretation of feature importance  .
After revision:  Bi-LSTM relieves the vanishing gradient problem, attentional mechanisms allow learning and interpretation of feature importance .