Patent ID: 8341112

Claim:
A memory storing computer program instructions executable by a processor, the computer program instructions including instructions for performing operations comprising: searching one or more data stores for images that are semantically related to a baseline annotation of a given image and visually similar to the given image; measuring visual similarity of the semantically related images to the given image, wherein at least a subset of the images are selected from certain ones of the images determined to be more visually similar to the given image than other ones of the images; calculating properties for phrases extracted from respective ones of annotations associated with the at least a subset of the images, the annotations being grouped into a respective cluster of multiple clusters; combining, for each cluster, associated ones of the properties to generate a salience score for the cluster, wherein common concepts are associated with one or more clusters having higher salience scores as compared to salience scores associated with other ones of the clusters; and annotating the given image with common concepts of annotations associated with at least a subset of the images that are both semantically related and visually similar to the given image.