mining emergent structures from mixed media for content retrieval
In this paper we present a novel approach for retrieval of thematic video content from mixed media. Based on the principles of conceptual blending, information from different media is mined for emergent structures from mixed media. We have built a system, called OntoMedia, to test the efficacy of this approach over traditional methods for media retrieval. The system employs an ontology as a unified indexing scheme for associated text documents for the mixed media content. By applying graph theoretic path finding operations to the ontology to process queries for video content, we show that the system is able to synchronize information from multiple media sources and retrieve semantically related content across media types. A trial experiment was carried out using mixed media courseware from the Singapore-MIT Alliance (SMA) distance education course. Results showed that information retrieval along a path performs significantly better than keyword-based and ontology-focused searches.
ontology unified indexing mixed media mining video retrieval