try regularization on RNN
check gradients
give up the trial for uncorrelated BRNN