Patent Document ID: 20170206435
Application ID: 14997011
Patent Flag: 0

Claim One:
1. A method implemented by a computing device to annotate individual images with multiple text labels to describe content of the images, the method comprising: processing a training image having multiple text labels to generate a set of image regions that correspond to the respective multiple text labels; embedding, within an embedding space that is configured to embed both text labels and image regions mapped to the text labels, the set of image regions based, in part, on positions at which the multiple text labels that correspond to the image regions of the training image are embedded in the embedding space; learning a mapping function that maps image regions to the text labels embedded in the embedding space, said learning based, in part, on said embedding the set of image regions within the embedding space; discovering text labels that correspond to image regions of a query image by mapping the image regions of the query image to the embedding space using the learned mapping function; and annotating the query image with at least two of the discovered text labels.