Patent ID: 7620552

Claim:
A computer-readable storage medium containing instructions for controlling a computer to automatically generate a summary of a program having video and audio by a method, the method comprising: identifying a plurality of content-generic events from the audio of the program by dividing the audio into windows and frames within each window; for each window, extracting energy features from the window and the frames within the window, the energy features including maximum energy, average energy, and energy dynamic range for different frequency bands; extracting phoneme-level features from the frames within the window, phoneme-level features including a Mel-frequency Cepstral coefficient (“MFCC”) and a first derivative of the MFCC; and extracting prosodic features from the window, the prosodic features including a non-zero pitch count of frames within the window that have a non-zero pitch value, a maximum pitch, a minimum pitch, an average pitch, and a pitch dynamic range; identifying windows that include speech based on whether the energy features at frequency bands corresponding to speech exceed a threshold and whether the derivative of the MFCC feature exceeds a threshold; for each identified window, determining whether the identified window includes excited speech based on the energy features and the prosodic features; and when a sequence of windows has been determined to include excited speech, indicating that the sequence corresponds to an excited speech event; identifying a plurality of content-specific events from the audio of the program; identifying portions of the program as a summary of the program based on the identified content-generic events and the identified content-specific events; wherein the content-generic events are identified based on a low-resolution analysis of the audio and the content-specific events are identified based on a high-resolution analysis of the audio.