Large amounts of text data are fed to the model during the training phase of GPT training to assist in finding patterns and connections between words, phrases, and sentences in a text. Teaching the model for producing human-like responses is the aim of this training.