Patent ID: 8527537

Claim:
A method of obtaining metadata associated with a media program, comprising the steps of: detecting an object in a frame of the media program; transmitting first data comprising the frame of the media program having the object to a display device for presentation to a first user, wherein the first user is viewing the media program through a video delivery service offering delivery of the media program; receiving user entered metadata from the first user for the object in the frame; tracking the object to determine proximate frames to the frame in which the object appears across the proximate frames of the media program; automatically associating the user entered metadata from the first user with the object in the frame with at least one of the proximate frames of the media program in response to receiving the user entered metadata from the first user and the determination of the proximate frames the object appeared across without user input indicating the first user entered metadata should be associated with the object in the proximate frames; comparing the user entered metadata from the first user with user entered metadata from second users for the object; verifying that the user entered metadata from the first user and the second users should be associated as additional metadata for the object in the media program based on the comparison; and upon verifying, associating the user entered metadata for the frame and the at least one of the proximate frames with the media program, wherein the associated user entered metadata is usable to provide a search result identifying the media program, and wherein a thumbnail of one of the frame and the proximate frames that depicts the object is determined from the user-entered metadata and used to identify the media program.