Patent ID: 8875212

Claim:
A system to control interaction with a first source of video data and a second source of associated metadata, the video data containing video images including a plurality of objects, the metadata associated with at least one of the plurality of objects, the system comprising: a video device configured to process the first source of video data and generate the video images, the video device further configured to use artificial image recognition methods to automatically identify object features in the video images and use these object features to identify metadata in the second source of metadata that is associated with the identified objects; and a portable device configured to communicate with the video device and to display the video images, the portable device further configured to synchronize the display of video images with the video device, the portable device further configured to receive spatio-temporal video image coordinate input from a user that selects an object in the video image, and wherein the portable device communicates the selected object to the video device, receives metadata from said second source that is associated with the selected object, and displays the received metadata to the user.