Patent ID: 8385588

Claim:
A method of processing audio signals including speech signals, the audio signals and image data being recorded in a media file, comprising: a. automatically extracting the speech signals from the audio signals from the media file and converting the speech signals to textual metadata wherein the textual metadata are keywords recognized from a pre-determined vocabulary; b. automatically analyzing the textual metadata using natural language processing algorithms to identify people's names, place names, or object names and adding the identified names to the textual metadata; c. using the updated textual metadata to compute a commentary value metric wherein the commentary value metric is a measure of the amount of viewer commentary associated with the media file; d. automatically semantically analyzing the image data from the media file to identify a person, place, object or activity to produce a visual display of selected portions of the image data, and prompt the user to provide additional textual metadata associated with each of the selected portions of the image data; and e. associating the updated textual metadata automatically obtained from the speech signals in the media file, the additional textual metadata provided by the user during the display of the selected portions of the image data from the media file, and the commentary value metric with the media file.