Before revision:  We then show how to improve the efficiency of recurrence methods in transformers, which let models condition on previously processed tokens ( when generating sequences that are larger than the maximal length that the transformer can handle at once ) . Existing methods require computationally expensive relative position embeddings;
After revision:  We then show how to improve the efficiency of recurrence methods in transformers, which let models condition on previously processed tokens ( when generating sequences that are larger than the maximal length that the transformer can handle at once . Existing methods require computationally expensive relative position embeddings;