Before revision:  Up until three years ago, all neural translation models translated sentences independently, without incorporating any extra-sentential information .
After revision:  Up until three years ago, almost all of the neural translation models translated sentences independently, without incorporating any extra-sentential information .