Surprisingly Easy Hard-Attention for Sequence to Sequence Learning
Breaking the Softmax Bottleneck: A High-Rank RNN Language Model