The course indeed covers the principles of the transformer architecture and the engine behind models like GPT-4. You will delve into transformers' self-attention mechanisms and how they are employed in state-of-the-art models. The course may not explicitly cover GPT-4, but the principles taught will enable you to understand it and similar models.