GPT-3 is the latest version of Generative Pre-Trained language models that is capable of more than just completing simple sentences. OpenAI presented GPT-3 in 2020 and enabled developers to use a beta API and try the model out. That’s how GPT-3 became a tremendous hit in the AI world overnight.
With 175 billion parameters, the model was trained in an unsupervised way. After analyzing 570GB of text data, it can write both fiction stories and code, answer questions, summarize texts, and make translations.
GPT-3 is especially good at writing news articles, making it challenging to distinguish them from human-made texts. What’s more, there is also a demo showing how GPT-3 creates an Instagram-like app using a Figma plugin for app design.
After such immense success, this trend spread across the globe. From Chinese PanGu with 200 billion parameters to Gopher with 280 billion parameters launched by DeepMind, these models have become the new forefront of competition among tech giants and progressive industries.