Patent Document ID: 10034028
Application ID: 14857002

Base Claim:
1. A method in a computer system for caption synchronization of media programs comprising receiving at least one portion of a media stream and at least one portion of a caption data stream in the computer system, wherein the at least one portion of the media stream and the at least one portion of the caption data stream correspond to an event; and the at least one portion of the media stream comprises timing information and at least one audio component; and utilizing at least one processing unit in the computer system to translate an audio signal into a sequence of word sounds in an audio stream; divide the audio stream into a plurality of overlapping audio stream segments that each correspond to a respective time slice of the audio stream, wherein each audio stream segment overlaps with a temporally adjacent audio stream segment such that temporally adjacent audio stream segments share a portion of the audio stream; translate the audio stream into a string of words using a combination of a base language model and an event specific language model; produce an audio-processed transcript by executing an indexing engine on the string of words, wherein the audio processed transcript includes a text stream of at least a plurality of sequences of words and timing information; align the audio-processed transcript with the at least one portion of the caption data stream; and generate a time synchronized caption data stream by applying the timing information from the audio-processed transcript to the at least one portion of the caption data stream based on the aligning.

---

Claim 18:
18. The method of claim 1 , wherein the aligning step further comprises: dividing the at least one portion of the caption data stream into a plurality of discrete caption data segments; selecting a first group of two or more audio stream segments; comparing the first group of audio stream segments to a first caption data segment to determine if a correlation exists between the first caption data segment and at least one of the two or more audio stream segments in the first group of two or more audio stream segments; if the correlation does not exist, assessing whether at least one of the two or more audio stream segments in the first group of two or more audio stream segments has an association with a successive caption data segment; and if the association does not exist, repeating the assessing step until an association is found between at least one of the two or more audio stream segments and at least one of the plurality of discrete caption data segments.