Patent ID: 8605141

Claim:
An augmented reality engine comprising: a remote device interface configured to receive ambient sensor data from a remote mobile sensing device over a network, the ambient sensor data reflecting a remote environment of a visually impaired person and including a current field of view and device position data; a panoramic engine configured to construct an augmented reality panorama representing a 3D digital model of the remote environment and including some of its objects at least partially based on the ambient sensor data with the current field of view integrated into the augmented reality panorama 3D digital model as a function of the device position; and a sighted assistant interface configured to: present visually the 3D digital model of the augmented reality panorama along with the integrated current field of view to a sighted assistant, generate device commands based on an interaction between the sighted assistant with at least one object in the 3D digital model and outside the current field of view, transmit, via the remote device interface, the device commands to the remote mobile sensing device, the device commands instructing the mobile sensing device to capture additional object data associated with the objects in the augmented reality panorama outside the integrated current field of view, and update the augmented reality panorama by incorporating the additional object data into the 3D digital model.