Before revision: To date, most state-of-the-art sequence modelling architectures use attention to build generative models for language based tasks.
After revision: To date, most state-of-the-art sequence modeling architectures use attention to build generative models for language based tasks.