The main challenges include acquiring enough GPUs to meet the high demands despite budget constraints, managing costs effectively without increasing tuition, and addressing the second-order challenges related to facility requirements like power, cooling, and space for housing GPUs.