Before revision:  We then show how to improve the efficiency of recurrence methods in transformers, which let models condition on previously processed tokens ( when generating sequences that are larger than the maximal length that the transformer can handle at once ) . Existing methods require computationally expensive relative position embeddings;
After revision:  We then show how to improve the efficiency of recurrence methods in transformers, which let models condition on previously processed tokens when generating sequences that are larger than the maximal length that the transformer can handle at once ) . Existing methods require computationally expensive relative position embeddings;