Patent Document ID: 20100303339
Application ID: 12645231
Patent Status: 0

Claim One:
1. A computer-implemented method for identifying an object in a real-world scene by pointing at the object with an electronic pointing device and electronically attaching feedback to the object in a digital representation of the object stored in system storage, comprising the steps of: (A) mapping a three-dimensional representation of the real-world scene containing at least one object and transmitting the three-dimensional representation to a system server; (B) inputting feedback relating to the at least one object to the pointing device; (C) inputting command statements respect to the least one object to the pointing device; (D) generating a request at the pointing device that includes at least the feedback and command statements, and transmitting the request to the system server along with a pointing device geodetic position and pointing direction; and (E) the system server performing the Substeps of, (1) generating a two-dimensional digital representation of the three-dimensional scene mapped at Step (A), with the two-dimensional digital representation including at least a digital representation of the at least one object, (2) identifying the at least one object according to the pointing device geodetic position and pointing direction applied to the two-dimensional digital representation, (3) processing the request and separating command statements and feedback from the request, (4) if the request includes only at least the command statement, executing the at least command statement and then performing Substep (E)(7), (5) if the request includes only feedback, linking the feedback to the digital representation of the at least one object stored in system storage and then performing Substep (E)(7), (6) if the request includes at least one command statement and feedback, executing the at least one command statement and linking feedback to the digital representation of the at least one object stored in system storage and then performing Substep (E)(7), (7) the system server communicating to the pointing device execution of at least one command statement and/or the linking of feedback.