Abstract:
Techniques for synchronizing audio and video data being transferred from one device to another device are disclosed. According to one aspect of the present invention, a periodic signal is generated in a host device (e.g., a personal computer) and transferred to a thin device (e.g., a PC camera) via an interface (e.g., a USB). The periodic signal is used to adjust local clocks in the thin device to generate audio and video data. As a result, the audio and video data is synchronized. According to another aspect of the present invention, an error detection unit and a correction unit are provided to ensure that there is no error in the periodic signal being transferred from the host device. If an error is detected, a patch to the signal is generated.

Description:
BACKGROUND OF THE INVENTION 
       [0001]    1. Field of the Invention 
         [0002]    The present invention relates to the area of video and audio signal processing, and more particularly to an apparatus and a method for synchronizing video and audio data. 
         [0003]    2. Description of Related Art 
         [0004]    It is an important problem to synchronize a video signal with an audio signal, provided that the video and audio signals are part of a media file. The video signal and the audio signal may have went through various processing, such as sampling, transferring, encoding, decoding. 
         [0005]    Referring to  FIG. 1 , which is a schematic block diagram showing a conventional USB (Universal Serial Bus) transfer system including a USB host controller  120  (e.g. a personal computer or PC) and a USB-based device  110  (e.g., a PC camera). The device  110  is connected with the USB host controller  120  via an USB interface, the device  110  may be provided to record audio and video data at the same time and transfer the data to the host controller  120 . The USB host controller  120  is provided to receive the audio and video data and play back them by a host clock thereof. 
         [0006]    The device  110  includes an audio clock generator  111 , an audio sampling unit  112 , a video clock generator  113  and a video sampling unit  114 . The audio clock generator  111  generates a local audio clock for the audio sampling unit  112 , the audio sampling unit  112  samples audio data at a predetermined sampling-rate by the local audio clock and transfers the audio data to the USB host controller  120  via the USB interface. At the same time, the video clock generator  113  generates a local video clock for the video sampling unit  114 , the video sampling unit  114  acquires video data at a predetermined frame-rate by the local video clock and transfers the video data to the host controller  120  via the USB interface. 
         [0007]    However, as shown in  FIG. 1 , since the local audio clock is independent from the local video clock and a random error may occur between the local audio clock and the local video clock, the video data may become out of sync with the audio data even if the video and audio data is recorded at the same time. With the random error accumulated, the synchronicity between the video data and the audio data may become worse. 
         [0008]    Furthermore, the host clock by which the host controller  120  plays back the video and audio data may also be out of synchronization with the local video and audio clock in the device  110 . Likewise, a random error may also occur between the host clock and the local clocks, which may further adversely influence the synchronicity between the video and audio data. 
         [0009]    Thus, there is a need for techniques for synchronizing the video data and the audio data in a transfer system. 
       SUMMARY OF THE INVENTION 
       [0010]    This section is for the purpose of summarizing some aspects of the present invention and to briefly introduce some preferred embodiments. Simplifications or omissions in this section as well as in the abstract or the title of this description may be made to avoid obscuring the purpose of this section, the abstract and the title. Such simplifications or omissions are not intended to limit the scope of the present invention. 
         [0011]    In general, the present invention pertains to techniques for synchronizing audio and video data being transferred from one device to another device. According to one aspect of the present invention, a periodic signal is generated in a host device (e.g., a personal computer) and transferred to a thin device (e.g., a PC camera) via an interface (e.g., a USB). The periodic signal is used to adjust local clocks in the thin device to generate audio and video data. As a result, the audio and video data is synchronized. 
         [0012]    According to another aspect of the present invention, an error detection unit and a correction unit are provided to ensure that there is no error in the periodic signal being transferred from the host device. If an error is detected, a patch to the signal is generated. 
         [0013]    One of the features, benefits and advantages in the present invention is to provide techniques for synchronizing audio and video data. 
         [0014]    Other objects, features, and advantages of the present invention will become apparent upon examining the following detailed description of an embodiment thereof, taken in conjunction with the attached drawings. 
     
    
     
       BRIEF DESCRIPTION OF THE DRAWINGS 
         [0015]    These and other features, aspects, and advantages of the present invention will become better understood with regard to the following description, appended claims, and accompanying drawings where: 
           [0016]      FIG. 1  is a schematic view showing a conventional USB transfer system including a USB host controller and a USB-based device; 
           [0017]      FIG. 2  is a schematic block diagram showing an apparatus for synchronizing video and audio data according to one embodiment of the present invention; 
           [0018]      FIG. 3  is a flowchart or process for synchronizing video and audio data according to one embodiment of the present invention; and 
           [0019]      FIG. 4  is a schematic block diagram for synchronizing video and audio data according to another embodiment of the present invention. 
       
    
    
     DETAILED DESCRIPTION OF THE INVENTION 
       [0020]    The detailed description of the present invention is presented largely in terms of procedures, steps, logic blocks, processing, or other symbolic representations that directly or indirectly resemble the operations of devices or systems contemplated in the present invention. These descriptions and representations are typically used by those skilled in the art to most effectively convey the substance of their work to others skilled in the art. 
         [0021]    Reference herein to “one embodiment” or “an embodiment” means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the invention. The appearances of the phrase “in one embodiment” in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. Further, the order of blocks in process flowcharts or diagrams or the use of sequence numbers representing one or more embodiments of the invention do not inherently indicate any particular order nor imply any limitations in the invention. 
         [0022]    Embodiments of the present invention are discussed herein with reference to  FIGS. 2-4 . However, those skilled in the art will readily appreciate that the detailed description given herein with respect to these figures is for explanatory purposes only as the invention extends beyond these limited embodiments. 
         [0023]      FIG. 2  is a schematic block diagram for synchronizing video and audio data according to one embodiment of the present invention. As shown in  FIG. 2 , the apparatus comprises a computing device including a USB interface, which is shown as a host controller  220 , and a USB device  210  (e.g., a PC camera). The device  210  is connected with the host controller  220  via an USB interface (not shown). The USB device  210  is provided to record audio and video signals at the same time and transfer corresponding audio and video data to the host controller  120 . The host controller  120  is provided to receive the audio and video data and play back the recorded audio and video data by a host clock thereof. 
         [0024]    The device  210  includes an audio clock generator  211 , an audio sampling unit  212 , a video clock generator  213  and a video sampling unit  214 . The audio clock generator  211  generates a local audio clock for the audio sampling unit  212 , the audio sampling unit  212  samples the audio signals by the local audio clock and transfers the audio data to the host controller  220  via the USB interface. At the same time, the video clock generator  213  generates a local video clock for the video sampling unit  214 , the video sampling unit  214  acquires corresponding video data by the local video clock and transfers the video data to the host controller  220  via the USB interface. 
         [0025]    As shown in  FIG. 2 , one of the important features, objects and benefits in the present invention is that the host controller  120  generates a periodical start of a frame (SOF) signal by the host clock and sends the signal to the audio and video clock generators  211  and  213 . In a particular implementation, the frequency of SOF may be 8 KHz when data transfers via the USB interface between the USB device and the host controller in a high speed mode and may be 1 KHz in a full speed mode. In one embodiment, the host controller  220  comprises a signal generator for generating the periodical SOF signal. 
         [0026]    After receiving each SOF signal, the audio clock generator  211  adjusts its output local audio clock according to the SOF signal, and the video clock generator  213  adjusts its output local video clock according to the SOF signal. As a result, the local audio and video clocks are synchronized with the host clock in the host controller since the SOF signal is generated from the host controller  220  and exactly synchronized with the host clock. 
         [0027]    As a result, the local audio and video clocks are indirectly synchronized with each other. The primary factor which influences the synchronicity of the audio and video data is eliminated. The host controller  220  can be configured to play back the audio and video data synchronously as long as the USB device  210  records the audio and video signals at the same time. 
         [0028]    In order to further understand the present invention,  FIG. 3  shows a flowchart or process  300  for synchronizing video and audio data according to one embodiment of the present invention. The process  300  may be understood in conjunction with  FIG. 2 . 
         [0029]    At  301 , a host device or controller  220  generates a periodical SOF signal (e.g., from its own host clock) and sends the SOF signal to the video clock generator  213  and the audio clock generator  211 . 
         [0030]    At  302 , the audio clock generator  211  adjusts the local audio clock according to the SOF signal and outputs an adjusted local audio clock to the audio sampling unit  212 ; at the same time, the video clock generator  213  adjusts the local video clock according to the SOF signal and outputs the adjusted local video clock to the video sampling unit  214 . 
         [0031]    At  303 , the audio sampling unit  212  samples an audio signal by the adjusted local audio clock and transfers the audio data to the host controller  220  via the USB interface. At the same time, the video sampling unit  214  acquires video data by the adjusted local video clock and transfers the data to the host controller  220  via the USB interface. 
         [0032]    With the received audio and video data, the host controller  220  can play back the audio and video data synchronously as long as the USB device  210  records the audio and video data at the same time. 
         [0033]    According to one embodiment, the SOF signal must be reliably transferred in order to ensure the synchronization of the host clock and the local clocks. If the SOF signal fails to be transferred, the synchronization of the host clock and the local clocks may be adversely influenced. Hence, an improved apparatus is provided hereafter for resolving the above problem according to an embodiment of the present invention. 
         [0034]    Referring now to  FIG. 4 , which shows an improved apparatus according to the preferred embodiment of the present invention, an error detecting unit  416  and a correction unit  415  is added into the USB device  410 . The error detecting unit  416  is provided for determining if the SOF signal from the host controller is lost. If yes, the error detecting unit  416  informs the correction unit  415  of patching one SOF signal immediately to the audio and video clock generator  411  and  413 , otherwise, the error detecting unit  416  and the correction unit  415  do nothing on the SOF signal so that the SOF signal is directly transferred to the audio and video clock generator  411  and  413 . It should be noted that the error detecting unit  416  and the correction unit  415  can also be implemented as one integrated unit in another embodiment. 
         [0035]    The process of the improved apparatus shown in  FIG. 4  is considerably similar to that of  FIG. 3  except for the process  301 . Namely, the process  301  may be improved by the following processes. first, the host controller  420  generates a periodical SOF signal by its own host clock and sends the signal to the error detecting unit  415 . Next, the error detecting unit  416  is configured to determine if the SOF signal from the host controller is lost. If yes, the error detecting unit  416  informs the correction unit  415  of patching one SOF signal to the audio and video clock generator  411  and  413 , otherwise, the error detecting unit  416  directly transfers the SOF signal to the audio and video clock generator  411  and  413 . 
         [0036]    In the above embodiment, the USB device  410  and the host controller  420  are taken as one example to describe the present invention. Actually, the USB host controller can be replaced by all type of controllers as long as it can accurately produce a periodical SOF signal by its own clock. Accordingly, the USB device can be replaced by all type of devices which can capture and transfer the audio and video data at the same time. Likewise, the SOF signal can also be replaced by a periodical signal as long as it can achieve the purpose of the SOF signal in the present invention. 
         [0037]    The present invention has been described in sufficient details with a certain degree of particularity. It is understood to those skilled in the art that the present disclosure of embodiments has been made by way of examples only and that numerous changes in the arrangement and combination of parts may be resorted without departing from the spirit and scope of the invention as claimed. Accordingly, the scope of the present invention is defined by the appended claims rather than the foregoing description of embodiments.