Input-to-Output Gate to Improve RNN Language Models
Recurrent Highway Networks