Generative Pretrained Transformers (GPT) are large language models that perform various tasks such as natural language processing, content generation, and common sense reasoning. They are used to make applications smarter by enabling them to understand and generate human-like text.