My read is that 3D environments don't work without glasses that respond to head movements or body rotation. Try playing 3D games on Nintendo - there isn't an effective perspective to operate from, and as a result, will probably hurt your head. A cool 3D system I saw was at Sikorsky. Their simulator placed you in the locus of a what looked like a radar dish. The environment was projected seamlessly on the dish.
Glasses can provide the same effect but better.
Also, with glasses, you simplify the compute task by not computing anything that is not in the field of vision. The reason that I believe that multiprocessor systems will be important for the future is that CPU speed is rapidly outpacing DRAM speed, to the extent that most current processors spend as much time waiting for RAM as processing. With more than one processor, maybe then my computer can walk and chew gum at the same time. Right now its a Ford. But the only way most people can publish what they produce is through e-mail.