Both RFE and Principal Component Analysis (PCA) are techniques used for feature selection. The key difference between the two is that PCA modifies the original attributes into a fresh set, while RFE eliminates the original attributes.