A Transformer is a type of machine learning model used in GPT to understand context and generate human-like text.