Patent ID: RE39345

Claim:
An audio/video/computer graphics data synchronous reproducing/synthesizing system comprising: separation means for separating a bit stream in which an audio signal, a video signal, and computer graphics data are compressed and multiplexed, into a compressed audio signal stream, an audio signal time reference value, a compressed video signal, a video signal time reference value, and a compressed computer graphics data stream; first clock generation means for generating a first decoding clock on the basis of the audio signal time reference value from said separation means; first decoding means for decoding the audio signal from the compressed audio signal stream from said separation means and the first decoding clock from said first clock generation means; first storage means for storing the decoded audio signal from said first decoding means; modulation means for modulating the audio signal from said first storage means in accordance with sound source control information; second clock generation means for generating a second decoding clock on the basis of the video signal time reference value from said separation means; second decoding means for decoding the video signal from the compressed video signal stream from said separation means and the second decoding clock from said second clock generation means; second storage means for storing the decoded video signal from said second decoding means; third decoding means for decoding the computer graphics data and event time management information from the compressed computer graphics data stream from said separation means; third storage means for storing the decoded computer graphics data from said third decoding means; event generation means for generating an event driving instruction on the basis of the second decoding clock from said second clock generation means and the event time management information from said third decoding means; detection means for detecting viewpoint movement of an observer using a pointing device; and rendering means for receiving the video signal stored in said second storage means, the computer graphics data stored in said third storage means, the event driving instruction from said event generation means, and viewpoint movement data from said detection means, and outputting a synthesized image of the video signal and the computer graphics data and the sound source control information used by said modulation means.