A method, comprising: presenting a stereoscopic three-dimensional, 3D, scene within a virtual space by at least one display, wherein said presenting the stereoscopic 3D scene comprises displaying at least one stereoscopic image of the stereoscopic 3D scene by the at least one display, wherein a user control device is used to manipulate objects within the stereoscopic 3D scene, and wherein the user control device includes one or more position or orientation sensors, and at least one visually detectable point, wherein the at least one visually detectable point includes first and second visually detectable points, wherein the first visually detectable point is configured to produce a first light field having a first opaque portion, wherein the second visually detectable point is configured to produce a second light field having a second opaque portion different than the first opaque portion; receiving first location information for the at least one visually detectable point from at least one tracking sensor configured to track the at least one visually detectable point in a physical space, wherein the at least one tracking sensor includes first and second cameras, wherein each of the first and second cameras is configured to capture multiple images with each image having a distinct perspective of the at least one visually detectable point, wherein the first and second cameras are separated far enough from each other to enable three-axis triangulation determination; determining second location information of the user control device based on the one or more position or orientation sensors of the user control device, wherein the one or more position or orientation sensors include a gyroscope, an accelerometer and/or a magnetometer; determining a position and an orientation of the user control device based on the first and second location information; and updating the stereoscopic 3D scene based on said determining the position and orientation of the user control device in the physical space, wherein the updated stereoscopic 3D scene in the virtual space correlates to the physical space. presenting a stereoscopic three-dimensional, 3D, scene within a virtual space by at least one display, wherein said presenting the stereoscopic 3D scene comprises displaying at least one stereoscopic image of the stereoscopic 3D scene by the at least one display, wherein a user control device is used to manipulate objects within the stereoscopic 3D scene, and wherein the user control device includes one or more position or orientation sensors, and at least one visually detectable point, wherein the at least one visually detectable point includes first and second visually detectable points, wherein the first visually detectable point is configured to produce a first light field having a first opaque portion, wherein the second visually detectable point is configured to produce a second light field having a second opaque portion different than the first opaque portion; receiving first location information for the at least one visually detectable point from at least one tracking sensor configured to track the at least one visually detectable point in a physical space, wherein the at least one tracking sensor includes first and second cameras, wherein each of the first and second cameras is configured to capture multiple images with each image having a distinct perspective of the at least one visually detectable point, wherein the first and second cameras are separated far enough from each other to enable three-axis triangulation determination; determining second location information of the user control device based on the one or more position or orientation sensors of the user control device, wherein the one or more position or orientation sensors include a gyroscope, an accelerometer and/or a magnetometer; determining a position and an orientation of the user control device based on the first and second location information; and updating the stereoscopic 3D scene based on said determining the position and orientation of the user control device in the physical space, wherein the updated stereoscopic 3D scene in the virtual space correlates to the physical space.