A SYSTEM AND METHOD FOR DYNAMICALLY SYNCHRONIZING A DIGITAL SOUNDTRACK WITH A MOVING PICTURE IN MOTION PICTURE MEDIA

Abstract: In a system and method for dynamically synchronizing a digital soundtrack with a moving picture in motion picture media, the system includes a device for presenting the motion picture media, wherein the motion picture media further includes an analog soundtrack. The digital soundtrack further includes a variable delay to compensate for the distance between a frame in the moving picture and a portion of the digital soundtrack corresponding thereto. A synchronizing device is correlated to a digital soundtrack pickup and an analog soundtrack picture in a feedback loop. A processor in the synchronizing device is adapted to process the digital soundtrack and the analog soundtrack to generate a control signal based on the difference between the location of a transient reference in the analog soundtrack and the same transient in the digital soundtrack, and to use the control system to adjust the variable delay in the digital soundtrack for synchronization thereof.

Description: A SYSTEM AND METHOD FOR DYNAMICALLY SYNCHRONIZING A DIGITAL SOUNDTRACK WITH A MOVING PICTURE IN MOTION PICTURE MEDIA BACKGROUND OF THE INVENTION Field of the Invention This invention relates generally to improvements in media sound playback systems, and, more particularly, to a new and improved system and method for dynamically synchronizing a digital soundtrack with a moving picture in motion picture media which includes a reference analog soundtrack, whereby the digital soundtrack plays back in synchronization with the moving picture for efficient and effective media sound playback. Description of the Related Art Digital sound has become an important pan of the movie business, because of the high quality of reproduction which it provides. Initially, analog sound was the only sound available for a movie. Analog sound in the movie business has made limited progress over the years, to being essentially marginally acceptable with relatively low quality sound provided thereby. The technical capabilities of the media for carrying analog sound were very limited, and did not meet the needs of the filmgoing public as well as the exhibitors to keep people coming to the theaters. In analog systems, there are two tracks in the film which play back in the theaters as four channels using a matrix encoding technology similar to quadrophonic sound to reproduce more channels than there actually are in the film, and similar in approach to stereophonic sound. With the advent of digital sound in recent years, the digital sound provides a much greater dynamic range, representing a quality improvement over analog sound, in that the quiet movements are truly quiet, the loud moments may become very loud, and there are more surround channels including sub-woofer channels to support sounds such as for example very low frequency explosions. At first, digital sound was an add-on to existing analog sound systems. The digital sound system included digital processing equipment including a digital reader to be mounted on the projector, and a separate digital processing box which fed digital sound to the amplifiers and to the loudspeakers. The only interface between the digital and analog systems was an automatic switch from the digital sound to the lower quality analog sound if there was a loss of digital sound, to provide continuous sound. Presently, digital sound systems and analog sound systems are integrated with the speaker systems in many theaters. However, problems may arise even if there is no loss of the digital soundtrack, for example where the digital soundtrack loses synchronization with the moving picture while the movie is being shown, which would prevent movie-goers from enjoying the movie. This condition may arise for any one of a number of reasons. The analog and digital soundtracks may be placed on the same film at different locations relative to each other, and at different locations relative to the location of the moving picture, to compensate for the locations of the analog and digital sound pickups relative to the picture gate and the lamphouse for projecting the moving pic t ure. The digital soundtrack may be recorded in the film with a delay to compensate for the location of the digital sound pickup ahead of the location of the picture gate and the lamphouse, and to compensate for the distance between the digital sound pickup and the picture gate and the lamphouse. The delay initially synchronizes the digital soundtrack with the moving picture. However, errors may be introduced in the pickup of the digital soundtrack which would cause loss of synchronization with the moving picture. The projectionist may thread the film in the projector in such a way that the digital soundtrack may be ou t of synchronization, by making the loop in the film too big or too small, which would change the distance of film travel between the digital sound pickup and the picture gate and lamphouse. Further, the design of the specific projector utilized may vary the distance between the digital sound pickup and the picture gate and lamphouse. Also, projectionists may not thread the film through all of the digital sound pickups associated with a projector, in systems wherein each pickup is adapted to function with one of a plurality of digital soundtrack formats. Errors may also occur in processing multiple prints of a film, causing the digital soundtrack to lose synchronization with the moving picture. In view of these considerations, an effective operational system should be implemented in a motion picture projecting system for the dynamic synchronization of the digital soundtrack with the moving picture. Therefore, those concerned with the development and use of digital sound in motion pictures have recognized the need for improved systems and methods for synchronizing the high quality digital soundtrack with the moving picture in a motion picture film, such that moviegoers may fully enjoy the experience of viewing a film without the disruption thereof caused by a loss of synchronization. Accordingly, the present invention fulfills these needs by providing efficient and effective dynamic synchronization of the digital soundtrack with the moving picture for an enhanced moviegoing experience and increased patron enjoyment. SUMMARY OF THE INVENTION Briefly, and in general terms, the present invention provides a new and improved system and method for dynamically synchronizing a digital soundtrack with a moving picture in an efficient and effective manner, while enhancing the viewing experience for the moviegoer at a motion picture theater. The system provides dynamic synchronization of the digital soundtrack by using an analog soundtrack in the same media as a reference, for effective synchronization thereof. By way of example, and not by way of limitation, the present invention provides a new and improved system and method for dynamically synchronizing the digital film soundtrack from a transient in the digital and analog soundtracks. More particularly, the present invention includes motion picture media including a moving picture, a digital soundtrack, and an analog soundtrack, and means for presenting the motion picture media. The system in accordance with the present invention further includes means for dynamically synchronizing the digital soundtrack and the moving picture with the analog soundtrack as a reference therefor. This is accomplished automatically through a feedback loop which generates a control signal from correlated information in the digital and analog soundtracks and adjusts a variable delay in the digital soundtrack responsive thereto. Therefore, one advantage of the present invention is that it includes a system for effectively synchronizing the digital soundtrack with the moving picture in motion picture media. A further advantage is that the present invention provides dynamically synchronizes the digital soundtrack with the moving picture while the motion picture media is being presented by the projecting device. Another advantage is that of the present invention provides automatic synchronization of the digital soundtrack and the moving picture upon loss of synchronization while the motion picture media is being presented by the projecting device. These and other objects and advantages of the invention will become apparent from the following more detailed description, when taken in conjunction with the accompanying drawings of illustrative embodiments. BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a fragmentary view of motion picture media which includes a digital soundtrack, an analog soundtrack, and a moving picture therein; FIG.2 is a partly representational paπly block diagram of a dynamically synchronizing media presenting system in accordance with the present invention; and FIG. 3 is a block diagram of a feedback loop for dynamic synchronization in the practice of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The present invention is directed to an improved system and method for dynamically synchronizing a digital soundtrack with a moving picture in an efficient and effective manner. The improved system and method provides synchronization of the moving picture and digital soundtrack responsive to a reference analog soundtrack, dynamically in real time while the moving picture is being presented on a screen, and wherein the digital soundtrack is in the same media as the analog soundtrack and the moving picture. Referring now to the drawings, wherein like reference numerals denote like or corresponding parts throughout the drawing figures, and particularly to FIGS. 1 and 2, a system 10 is utilized for dynamically synchronizing a digital soundtrack 12 with a moving picture 14 in a motion picture media 16 such as a movie film, using a corresponding analog soundtrack 18 on the media 16 as a reference. The media 16 may further include sprocket perforations 20 for enabling the threading thereof into a device 22 for presenting the moving feature 14 on a screen 24. The presenting device 22 may comprise for example a motion picture projector. The system 10 further includes a device 26 for picking up the digital soundtrack 12, and a device 28 for picking up the analog soundtrack 18, which are associated with the presenting device 22. As shown in FIG. 2, the presenting device 22 includes an assembly 30 for projecting the moving picture 14 onto the screen 24. The projecting assembly 30 includes a picture gate and a lamphouse including a lamp and a lens assembly. The presenting device 22 further includes a plurality of rollers, takeup rollers, and shrocket wheels (not shown) through which the media 16 is threaded, which define a path of movement 32 for transporting the media 16 through the projecting device 22. In accordance with the present invention, the system 10 also includes a device 34 for synchronizing the digital soundtrack 12 with the moving picture 14. The synchronization device 34 includes a processor 36 and software for processing digital signals, and is connected to the digital soundtrack pickup device 26, the analog soundtrack pickup device 28, and a speaker system 38, for broadcasting the digital soundtrack 12 and showing the moving picture 14 in synchronization therewith. As seen in FIGS. 1-3, the system 10 further includes a feedback loop 40, wherein the digital soundtrack 12, which is processed through a variable delay 42 which delays the pickup of the digital soundtrack 12, is fed back through the synchronizing device 34 along with the analog soundtrack 18, and is processed through the synchronizing device 34 to generate a control signal 44 for controlling the variable delay 42. The variable delay 42 is adapted to compensate for the location of the digital sound pickup 26 ahead of the projecting assembly 30 for projecting the moving picture 14, and is variable responsive to the control signal 44. The synchronization device 34 is adapted to detect a selectable reference which is common to the digital soundtrack 12 and the analog soundtrack 18. The reference may preferably comprise for example a transient element comprising a discrete sound-generating event in the media 16. As illustrated in FIG. 1, the analog soundtrack 16 may be placed on the media 16 at a location thereon for example inside the sprocket perforations 20. The digital soundtrack 12 may be placed on the media 16 at a location thereon not otherwise used, such as for example in the edges of the media 16 outside the sprocket perforations 20. The analog soundtrack 16 may be recorded on the media 16 at a location ahead of the moving picture 14 thereon, for example at a standard location for thirty-five millimeter film of twenty frames ahead of the moving picture 14. The analog soundtrack 16 may then be picked up by the analog soundtrack pickup device 28, at a location thereof for example at a standard distance after the projecting assembly 30 in the path of movement 32 of the media 16 through the presenting device 22, to synchronize the analog soundtrack 16 with the moving picture 14. The digital soundtrack 12 may be recorded on the media 16 with a delay relative to the moving picture 14, and may then be picked up by the digital soundtrack pickup device 26 at the location thereof ahead of the projecting assembly 30 in the path of movement 32 of the media 16 through t he presenting device 22, to initially synchronize the digital soundtrack 12 with t he moving picture 14. The digital soundtrack 12 may then be synchronized with the moving picture 14 at the location where the media is to be presented, such as in an auditorium in a movie theater, by an installer by running a film, listening by headphones or in the auditorium, and adjusting the variable delay forward or backwards until synchronization is heard in the auditorium. The adjustment may be made in hardware by rotating a thumbled-wheel switch or in software on a laptop computer, to set the variable delay to the length of the path 32. After the delay is set and adjusted, a projectionist may introduce errors in installing a media 16 in a presenting device 22 for a particular show in a way which may cause the digital soundtrack 12 to be out of synchronization with the moving picture 14. In threading the media 16 into the projecting device 22, the projectionist may so configure the media 16 that the digital soundtrack 12 may be out of synchronization rela t ive to the moving picture 14. The projectionist may for example make a loop in the media 16 either too big or tightened too much, which would change the length of the path 32, for example to the extent of one or two frames in the media 16. Such a path change would throw the digital soundtrack 12 and the moving picture 14 out of synchronization. Also, the distance in the presenting device 22 between the digital sound t rack pickup device 26 and the projecting assembly 30 may vary depending upon the specific equipmen t , and may in particular for example vary from one foot to three or four feet because of the design thereof, which may also result in the loss of synchronization of the digital soundtrack 12 and the moving picture 14. Further, the media 16 presently may include any of a plurality of different formats of the digital soundtrack 12, and the presenting device 22 may include a plurality of digital soundtrack pickup devices 26 associated therewith which have the capability of showing the different digital soundtrack formats. Projectionists may forget to thread the media 16 through all such digital soundtrack pickup devices 26, or may thread only one such device 26 which changes the length of the path 32 between the digital soundtrack pickup device 26 and the projecting assembly 30 which may also cause the digital soundtrack 26 to be out of synchronization. Aside from projectionist error, processing errors may occur, which may cause the digital soundtrack 12 to be placed on the media 16 at an unintended place, for example either slightly ahead or slightly behind where it should be relative to the moving picture 14. Such processing errors may include for example errors in laying up the digital soundtrack 12 in printing up the negative from one print of the media 16 to another. Also, uncertainty over where the absolute start mark may be located, such as a blip which may be in the wrong place relative to the digital soundtrack 12. In the present invention, the synchronization device 34 herein is adapted to adjust the digital soundtrack delay 42 while the media 16 is being presented by the presenting device 22, to dynamically synchronize the digital soundtrack 12 with the moving picture 14 where both are embedded in the same media 16. The synchronization device 34 uses the analog soundtrack 18 as a guide reference, dynamically comparing thereto the same information in the digital soundtrack 12. The correlated information in the media 16, comprising the reference information in the analog soundtrack 18 and the same information in the digital soundtrack 12, may comprise a specific transition or the like constituting a signal with a unique characteristic, such as for example changes, pulses, a door slamming, a person starting to speak, a spoken syllable, an explosion or a gunshot. The analog soundtrack 18 and the digital soundtrack 12 are generally highly correlated, since both support the same movie and dialog. In particular and in accordance with the present inven t ion, t he processor 36 in t he synchroniza t ion device 34 is adapted to examine t he con t en t of t he analog soundtrack 18 and t he digital soundtrack 12 and derive a con t rol signal 44 from both soundtracks which represents the correlated information of a t ransient na t ure. The derived con t rol signal 44 cons t itutes an error signal which is either plus or minus depending upon how t he correlated information differs, and responsive thereto t he synchroniza t ion device 34 dynamically adjusts and con t rols the variable delay line 42 between t he digital sound pickup 26 and the projecting assembly 30 t o synchronize t he digi t al soundtrack 12 and the moving pic t ure 14. In accordance wi t h t he present invention, the processor 36 analyzes t he transien t s in t he sound t rack and may generate for example a charac t eristic ma t hema t ical signal cons t i t u t ing an error control signal 44 which may for example comprise a plus or minus vol t age, which controls the variable delay line 42 t o minimize the error signal, comprising a feedback loop 40. For example, if a signal is found in the analog sound t rack 18, and t he same signal is found in the digi t al soundtrack 12 wi t hin one second thereafter, t he assumption would be that the digi t al sound t rack 12 was running behind t he analog soundtrack 18, and a control signal comprising an error signal could be generated t ha t would change the variable delay line 42 t o move the digi t al sound t rack back t o minimize the error. The presen t invention provides improved sys t ems and me t hods for synchronization of errors which manifes t themselves t hroughout t he showing of a film unless correc t ed. The synchroniza t ion device 34 is adap t ed to make an adjustment once for each showing of a film, usually wi t hin a short period of t ime of the beginning of the presen t a t ion of the film, such as for example within t he firs t few seconds. The adjustmen t is implemented wi t hin t he time i t t akes t o make the calcula t ion, generate the error signal, and correc t t he error, which would also be dependent upon the types of transi t ions in t he film. In accordance with the present invention, the system and me t hod provide for dynamic synchronization in real time of the digi t al soundtrack wi t h t he moving pic t ure while t he moving picture is being projected on t o a screen, using t he analog soundtrack as a reference. I t will be apparen t from t he foregoing that, while particular forms of t he inven t ion have been illus t ra t ed and described, various modifica t ions can be made withou t depar t ing from t he spirit and scope of the invention. Accordingly, i t is not in t ended t ha t t he inven t ion be limited, except as by the appended claims.

Claims: WHAT IS CLAIMED IS: 1. A system for dynamically synchronizing a digital soundtrack and a moving picture, when the digital soundtrack and the moving picture are not in synchronization, comprising: motion picture media, which includes a moving picture, and a digital soundtrack and an analog soundtrack therein; means for presenting the motion picture media; and means for dynamically synchronizing the digital soundtrack with the moving picture in the motion picture media, wherein the analog soundtrack is a reference therefor, when the digital soundtrack and the moving picture become out of synchronization while presenting the motion picture media in the presenting means. 2. The system of claim 1, wherein the synchronizing means include means for processing the digital soundtrack and the analog soundtrack. 3. The system of claim 1, wherein the presenting means include means for projecting the moving picture, further comprising means for detecting the digital soundtrack and means for detecting the analog soundtrack which are associated with the presenting means, and wherein the presenting means further include a path of movement of the motion picture media through the digital soundtrack detecting means, the analog soundtrack detecting means, and the moving picture projecting means. 4. The system of claim 1, wherein the motion picture media comprises a motion picture film. 5. The system of claim 1, wherein the synchronizing means automatically synchronize the digital soundtrack with the moving picture dynamically while presenting the motion picture media in the presenting means. 6. The system of claim 2, wherein the digital soundtrack includes a vaπa ble delay therein relative to the moving picture, the analog soundtrack includes reference selectable therein and the digital soundtrack includes a corresponding reference selectable therein, and the processing means comprise means for detecting the selected analog soundtrack reference, the selected digital soundtrack reference, and the difference therebetween so as to generate a control signal derived therefrom, and for adjusting the digital soundtrack variable delay responsive to the control signal generated, so as to synchronize the digital soundtrack and the moving picture. 7. The system of claim 3, wherein the digital soundtrack detecting means are located in the media movement path before the location of the projecting means. 8. The system of claim 3 , wherein the analog soundtrack detecting means are located in the media movement path after the location of the projecting means. 9. The system of claim 3, wherein the projecting means comprise elements for enabling the moving picture to be projected onto a screen. 10. The system of claim 6, wherein the selectable analog soundtrack reference and the corresponding selectable digital soundtrack reference comprise a transient element in the motion picture med i a. 11. The system of claim 6, further comprising a feedback loop which includes the digital soundtrack including the delay therein, the analog soundtrack, the synchronization means including the processing means, and the control signal. 12. The system of claim 10, wherein the transient element comprises a discrete sound-generating event in the motion picture media. 13. The system of claim 10, wherein the synchronizing means are further adapted to analyze the transient element and generate characteristic signals therefrom, and wherein the error signal comprises the difference between the locations of the transient element characteristic signals in the analog soundtrack and the digital soundtrack. 14. A method of dynamically synchronizing a digital soundtrack and a moving picture, when the digital soundtrack and the moving picture are not in synchronization, in a system which includes motion picture media, which includes a moving picture, and a digital soundtrack and an analog soundtrack therein, means for presenting the motion picture media, and means for dynamically synchronizing the digital soundtrack with the moving picture in the motion picture media, wherein the analog soundtrack is a reference therefor, when the digital soundtrack and the moving picture become out of synchronization while presenting the motion picture media in the presenting means, comprising the steps of: presenting the motion picture media, including detecting the digital soundtrack, displaying the moving picture, and detecting the analog soundtrack; and dynamically synchronizing the digital soundtrack with the moving picture wherein the analog soundtrack is a reference therefor, when the digital soundtrack and the moving picture are not in synchronization while presenting the motion picture media in the presenting means. 15. The method of claim 14, wherein the synchronizing means include means for processing the digital soundtrack and the analog soundtrack, and the synchronizing step comprises processing the digital soundtrack and the analog soundtrack. 16. The me t hod of claim 14, wherein the presenting means include means for projec t ing the moving picture, further comprising means for detec t ing t he digital sound t rack and means for detecting the analog sound t rack which are associated with the presen t ing means, and wherein the presenting means further include a path of movemen t of the mo t ion picture media through the digital sound t rack de t ecting means, t he analog sound t rack detecting means, and the moving pic t ure projec t ing means, wherein t he synchronizing step comprises inserting t he mo t ion pic t ure media in t he movemen t pa t h such t ha t the motion picture media moves firs t t hrough t he digital sound t rack de t ec t ing means, then through the moving pic t ure projec t ing means, and then t hrough t he analog soundtrack detecting means. 17. The me t hod of claim 14, wherein the motion picture media comprises a mo t ion pic t ure film, the presenting step comprises presen t ing t he mo t ion pic t ure film in t he presen t ing means, and the synchronizing s t ep comprises dynamically synchronizing t he digital soundtrack with the mo t ion pic t ure film responsive to the analog soundtrack. 18. The me t hod of claim 14, wherein the synchronizing means au t oma t ically synchronize t he digital soundtrack with the moving pic t ure dynamically while presen t ing t he mo t ion picture media in the presenting means, and t he synchronizing s t ep includes au t omatically synchronizing the digi t al sound t rack with the moving pic t ure dynamically while presenting the motion pic t ure media in the presenting means. 19. The me t hod of claim 15, wherein the digital soundtrack includes a variable delay t herein rela t ive t o the moving picture, the analog sound t rack includes a reference selectable t herein and the digital soundtrack includes a corresponding reference selec t able therein, and the processing means comprise means for de t ec t ing the selec t ed analog sound t rack reference, the selected digital sound t rack reference, and the difference therebetween so as to generate a control signal derived therefrom, and for adjusting the digital soundtrack variable delay responsive to the control signal generated, so as to synchronize the digital soundtrack and the moving picture, and the synchronizing step comprises adjusting the digital soundtrack variable delay responsive to the control signal generated. 20. The method of claim 16, wherein the digital soundtrack detecting means are located in the media movement path before the location of the projecting means, and the synchronizing step comprises detecting the digital soundtrack before projecting the moving picture. 21. The method of claim 16, wherein the analog soundtrack detecting means are located in the media movement path after the location of the projecting means, and the synchronizing step comprises detecting the analog soundtrack after projecting the moving picture. 22. The method of claim 16, wherein the projecting means comprise an elements for enabling the moving picture to be projected onto a screen, and the projecting step comprises projecting the motion picture onto a screen. 23. The method of claim 19, wherein the selectable analog soundtrack reference and the corresponding selectable digital soundtrack reference comprise a transient element in the motion picture media, and the synchronizing step comprises adjusting the digital soundtrack variable delay responsive to the difference between the analog soundtrack transient and the digital soundtrack transient. 24. The method of claim 19, further comprising a feedback loop which includes the digital soundtrack including the variable delay therein, the analog soundtrack, the synchronizing means including the processing means, and the control signal, wherein the synchronizing step comprises adjusting the digital soundtrack variable delay responsive to processing the digital soundtrack through the feedback loop. 25. The method of claim 23 , wherein the transient element comprises a discrete sound-generating event in the motion picture media, and the synchronizing step comprises adjusting the digital soundtrack variable delay responsive to the difference between the locations of the discrete sound-generating event in the analog soundtrack and in the digital soundtrack. 26. The method of claim 23, wherein the synchronizing means are further adapted to analyze the transient element and generate characteristic signals therefrom, and wherein the error signal comprises the difference between the location of the transient element characteristic signals in the analog soundtrack and the digital soundtrack, and the synchronizing step comprises adjusting the digital soundtrack variable delay responsive to the difference between the locations of the transient element characteristic signals in the analog soundtrack and the digital soundtrack.

Inventors: MEAD WILLIAM H, MEAD, WILLIAM, H.
Applicants: SONY CINEMA PRODUCTS CORP, SONY CINEMA PRODUCTS CORPORATION
Application year: 1999
Main classification: G03B31
IPC codes: G03B31, G11B27