OpenAI has successfully applied continual learning in the development of models like GPT-3, which can learn and adapt to new tasks without forgetting previous knowledge. This has enabled the creation of more versatile AI systems that can handle a wide range of tasks and applications, such as natural language understanding, translation, summarization, and question-answering.