Patent ID: 8682739

Claim:
A non-transitory computer-readable medium embodying a program executable in a computing device, the program comprising: code that receives a video, the video comprising a plurality of video frames; code that, in response to receiving the video comprising a plurality of video frames, extracts at least a subset of the video frames; code that identifies a set of objects in the subset of the video frames; code that performs image recognition on individual ones of the set of objects; code that compares a result of the image recognition with product imagery associated with a set of products available via an electronic commerce system; code that performs text recognition on individual ones of the set of objects; code that compares a result of the text recognition with textual data associated with the set of products available via the electronic commerce system; code that ranks the set of products in the subset of the video frames according to a prominence of individual ones of the set of products in the video, the prominence based upon a percentage of the subset of the video frames in which individual ones of the set of products appears and a size of individual ones of the set of products relative to other products appearing in the subset of the video frames; code that generates a respective hyperlink associated with individual ones of the set of products; code that inserts individual hyperlinks in an interactive layer, the interactive layer overlaid on a video layer in a video player user interface, wherein individual hyperlinks are placed at a position corresponding a location of a corresponding one of the set of products; code that identifies at least a subset of the set of products based on the prominence ranking; and code that displays in an information pane, the identified at least a subset of the set of products in a ranked list based on the prominence ranking.