Before revision:  By combining these techniques, we increase training speed by 65\%, make generation nine times faster , and substantially improve perplexity on WikiText-103, without adding any parameters.
After revision:  We show that these recurrent models also benefit from short input lengths. Combining these techniques speeds up training by a factor of 1.65, reduces memory usage , and substantially improve perplexity on WikiText-103, without adding any parameters.