OpenAI trained ChatGPT using reinforcement learning from human feedback. It's a method through which a machine learns by observing human intervention to achieve a realistic result. It is based on the GPT-3.5 architecture.