A Parallel Recurrent Neural Network for Language Modeling with POS Tags.
Context dependent recurrent neural network language model