We present a novel approach to automatically annotate images using associated text. We detect and classify all entities (persons and objects) in the text after which we determine the salience (the importance of an entity in a text) and visualness (the extent to which an entity can be perceived visually) of these entities. We combine these measures to compute the probability that an entity is present in the image. The suitability of our approach was successfully tested on 100 image-text pairs of Yahoo! News.
Deschacht and Moens REF used salience (the importance of an entity) and visualness (the extent to which an entity can be perceived) to assign image with tags.
Text Analysis for Automatic Image Annotation
45th Annual Meeting of the Association of Computational Linguistics
Computer Science