Learning Simpler Language Models with the Delta Recurrent Neural Network Framework.
Learning Longer Memory in Recurrent Neural Networks