Patent Document ID: 20100306707
Application ID: 12645243
Patent Status: 0

Claim One:
1. A computer-implemented method for responding to spatial queries about a real-world object of interest using a reference object to identify the object of interest, comprising the steps of: (A) generating a query statement relating to at least one object of interest with an electronic pointing device, with the query statement including at least a query topic and a spatial preposition, and generating a pointing device geodetic position and pointing direction, and transmitting the query statement and pointing device geodetic position and pointing direction to a system server; (B) mapping a three-dimensional representation of a real-world scene including at least the object of interest and the reference object, and transmitting the three-dimensional representation to the system server; (C) a system server performing the Substeps of, (1) generating a two-dimensional digital representation of the three-dimensional scene mapped at Step (B), with the two-dimensional digital representation including at least a digital representation of the object of interest and the reference object, (2) identifying the reference object and the reference object position according to the pointing device geodetic position and pointing direction applied to the two-dimensional digital representation, (3) annotating the two-dimensional digital representation for identifying the object of interest according to the position of the reference object, the query topic, and spatial preposition, (4) identifying the object of interest according to be annotated two-dimensional digital representation at Substep (C)(3) by linking the query topic and spatial preposition of the query statement to an object in the two-dimensional digital representation, and (5) the system server communicating with the pointing device and transmitting at least the identification of the object of interest to the pointing device.