What is the difference between pretraining and RAG?
Pretraining is when the model is trained on a large dataset to learn general patterns, while RAG enhances a pre-trained model with real-time external data during inference.