Before revision:  We also added attention layer at top of rnn layer in our model to compute the  attention scores of each hidden layer corresponding to each input timestep.
After revision:  We also added attention layer at top of rnn layer in our model to compute the feature ranking of each timestamp and attention scores of each hidden layer corresponding to each input timestep.