Patent ID: 8903430

Claim:
A method of locating and interacting with an external object comprising: obtaining real-time imagery from a mobile camera; retrieving stored image data and metadata regarding a known environment, the known environment comprising a plurality of known objects; receiving a signal from a first object, the first object corresponding to a first known object of the plurality of known objects, the signal identifying a position of the first object relative to the mobile camera; identifying a first stored position of the first known object relative to the plurality of known objects based on the stored image data and metadata; comparing the real-time imagery to the stored image data and metadata to determine a position of the mobile camera relative to the plurality of known objects; presenting the real-time imagery on a mobile display associated with the mobile camera; determining information related to the first object based on the stored image data and metadata regarding the first known object; presenting information related to the first object as a graphical overlay on the real-time imagery; and accessing an operational interface of the first object via a user interface comprised in the graphical overlay, wherein accessing the operational interface of the first object comprises at least one of: sending data, receiving data, and sending commands.