Before revision:  We evaluate these memory augmented Transformers on machine translation task and demonstrate that memory size positively correlates with the model performance .
After revision:  We evaluate these memory augmented Transformers and demonstrate that memory size positively correlates with the model performance .