He acknowledges the enormous potential for interdisciplinary research that such a problem provides. They have investi 40 gated a system for generating natural language descriptions of traffic scenes. Verbs of locomotion are used to express the activity present in a sequence of images. Event models for recognition and natural language description of events in real-world image sequences . In Proceedings 8th International Joint Conference Artificial Intelligence, 1983.
Visual salience is used as a key heuristic in deciding the order of mention of objects.
The focus here is entirely on the natural language generation process, and the visual information is used only as interesting data for this process. They address the problem of recognising events based on intermediate level visual percepts obtained at different instances of time. B. Neumann and H. Novak. Event Models for Recognition and Natural Language Description of Events in Real-World Image Sequences . Instead , the components of the GSD are appropriately tailored to suit each system.