Natural language processing also has a role in query matching for optimal retrieval from the story texts. Finally, the system would greatly improve if queries could be parsed to separate out dates, major concepts and types of news sources. Within a scene and within a story, image processing gives us the key frame to represent that scene or story. The choice of a single key frame to best represent a whole scene is a subject of active research. In the future, we also hope to include similarity-based image matching in the retrieval features available to a user.
Speech recognition helps create a time-aligned transcript of the spoken words.
For news broadcasts that are not close-captioned, we need a transcript generated exclusively by the speech recognition system. During library exploration, speech recognition allows a user to query the system by voice, simplifying the interface by making the interaction more direct. The integration of speech with the interface enhances access to the stored video data by allowing more immediate and direct entry of queries.