High-performance GPUs or TPUs are generally used for training Deep Learning models because of their parallel processing abilities.