Before revision:  We evaluate these memory augmented Transformers on machine translation task and demonstrate that memory size positively correlates with the model performance .
After revision:  We evaluate these memory augmented Transformers on machine translation task and demonstrate that presence of memory positively correlates with the model performance .