A Parallel Recurrent Neural Network for Language Modeling with POS Tags.
TopicRNN: A Recurrent Neural Network with Long-Range Semantic Dependency