The main challenge in using React for immersive 3D apps is that React is render-oriented, while 3D worlds and simulations are data-oriented. This means React's top-to-bottom state flow isn't well-suited for the real-time updates required by 3D simulations.