Given these paragraphs about Large language models, what popular neural network architecture architecture are they based on?

The Transformer architecture.