Architectures like RNNs, LSTMs, and transformer-based models (e.g., GPT, BERT) are commonly used for training language models.