Simple Recurrent Units for Highly Parallelizable Recurrence.
Factorization tricks for LSTM networks