Patent Document ID: 8208737
Application ID: 12425500

Base Claim:
1. A computer-implemented captioner for analyzing data representative of image captions in media material, comprising: a text block detector configured to identify text-blocks in a media material; an image detector configured to identify images in the media material; a proximity feature analyzer configured to analyze the location of the text-blocks relative an image in the media material; a caption identifier module configured to identify potential captions associated the identified image images based, in part, on at least one of the results from the proximity feature analyzer; a textual feature analyzer configured to analyze textual features of a potential caption, resulting in a textual feature score; an image feature analyzer configured to analyze features of the identified image, resulting in an image feature score, wherein the proximity feature analyzer is further configured to analyze the proximity features of at least one potential caption relative to one or more identified images, resulting in at least one proximity feature score; a weight applier configured to apply weights to one or more scores from the proximity feature analyzer, textual feature analyzer and image feature analyzer, resulting in one or more weighted scores; a caption score generator configured to generate a probability score that the potential caption is linked to the identified image based on at least one of the results of the weight applier; a caption feedback module configured to receive user feedback about at least one of the potential captions; a caption identifier module configured to determine, based on the received user feedback and the probability score, that at least one potential caption has a linkage to an identified image, and is an actual caption of the identified image; and a linkage storer configured to store information corresponding to the linkage between the actual caption and the associated identified image, the storage of information corresponding to the linkage being limited based on a threshold applied to the probability score.

---

Claim 2:
2. The computer-implemented captioner of claim 1 , wherein the textual features analyzed by the textual feature analyzer include visual features of the text.