Patent Document

CROSS-REFERENCE TO RELATED APPLICATION 
       [0001]    The present application claims priority from Japanese Patent Application No. JP 2010-082341 filed in the Japanese Patent Office on Mar. 24, 2010, the entire content of which is incorporated herein by reference. 
       TECHNICAL FIELD 
       [0002]    The present invention relates to a camera system, a signal delay amount adjusting method and a program. 
       BACKGROUND ART  
       [0003]    Patent Literature 1 below has disclosed, for example, a camera control apparatus capable of controlling a plurality of cameras by one unit thereof. Patent Literature 1 has disclosed a configuration in which a Camera Head Unit (CHU) and a Camera Control Unit (CCU) are connected via a camera cable on a one-to-one basis to transmit reference signals and video signals. 
         [0004]    Further, Patent Literature 2 below has disclosed a method using an asynchronous switching network (an asynchronous transmission network) for transmitting between the CHU and the CCU. 
       CITATION LIST  
     Patent Literature 
       [0005]    [PTL 1] 
         [0006]    Japanese Unexamined Patent Application Publication No. 09-238277 
         [0007]    [PTL 2] 
         [0008]    Japanese Unexamined Patent Application Publication No. 2004-304809 
       SUMMARY   
       [0009]    When a video transmission is performed using the asynchronous transmission network as described in the Patent Literature 2, a transmission path varies for each combination of each of the CHU and the CCU, and therefore, a delay amount will be varied. For this reason, it is necessary to align arrival timing of video signals in each of the CCU by adjusting timing. Especially, since a route path is not fixed on the asynchronous transmission network and the route path varies depending on the situation, it is difficult to adjust timing of the video signals. 
         [0010]    Moreover, since a development of a camera system increases flexibility in case of the asynchronous transmission network, it is preferable that switching an asynchronous transmission wire such as a LAN cable, or a device such as a switching hub, a router, or the like, for example, can be flexibly accepted. In such case, adjusting timing of the video signals will be difficult. 
         [0011]    Further, by using the asynchronous transmission network, when a failure occurs on the route path currently in use, there is an advantage in developing a redundant configuration against the failure on a transmission device by changing into a different route path, however, it is also necessary to adjust the timing of the video signals in a flexible way according to the change of the route path. 
         [0012]    Further, due to a bandwidth limitation of the asynchronous transmission network, it is assumed that transmission may be performed after a video compression (encoding) in the CHU to compress (decoding) the compressed image in the CCU. In this case, it is necessary to consider a delay due to the encoding and decoding, accompanying with complicated processing for adjusting timing. 
         [0013]    In light of the foregoing, it is desirable to provide a camera system, a signal delay amount adjusting method, and a program, which are novel and improved, and which are capable of easily adjusting timing of video signals when a plurality of cameras are connected via an asynchronous transmission network. 
         [0014]    Accordingly, the present system and method for adjusting one or more signal delays is provided. In one embodiment, the signal delays are adjusted by obtaining delay amounts of video signals associated with respective camera units and respective camera control units, the camera units being coupled to respective ones of the camera control units via an asynchronous network, and adjusting one or more of the delay amounts. 
     
    
     
       BRIEF DESCRIPTION OF DRAWINGS 
         [0015]    [ FIG. 1 ] 
           [0016]      FIG. 1  is a block diagram for illustrating a camera control system in which a camera (CHU) and a CCU are connected in a one-to-one basis. 
           [0017]    [ FIG. 2 ] 
           [0018]      FIG. 2  is a schematic view for illustrating an example of a camera system using an asynchronous transmission network according to an embodiment of the present invention. 
           [0019]    [ FIG. 3 ] 
           [0020]      FIG. 3  is a schematic view for illustrating the system illustrated in  FIG. 2  in more detail. 
           [0021]    [ FIG. 4 ] 
           [0022]      FIG. 4  is a schematic view for illustrating a configuration for adjusting a delay amount in detail. 
           [0023]    [ FIG. 5 ] 
           [0024]      FIG. 5  is a schematic view for illustrating a configuration for adjusting a delay amount in detail. 
           [0025]    [ FIG. 6 ] 
           [0026]      FIG. 6  is a schematic view for illustrating a case where a delay amount Ts of a certain CHU other than a main camera is less than a reference delay time Tb. 
           [0027]    [ FIG. 7 ] 
           [0028]      FIG. 7  is a schematic view for illustrating a case where a delay amount T 1  of a certain CHU other than a main camera is larger than a reference delay time Tb. 
           [0029]    [ FIG. 8 ] 
           [0030]      FIG. 8  is a flowchart for illustrating a procedure of the system according to the present embodiment. 
       
    
    
     DESCRIPTION OF EMBODIMENTS  
       [0031]    Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the appended drawings. Note that, in this specification and the appended drawings, structural elements that have substantially the same function and structure are denoted with the same reference numerals, and repeated explanation of these structural elements is omitted. 
         [0032]    The explanation will be given in the order shown below. 
         [0033]    1. Technological Basis 
         [0034]    2. Configuration Example of a Camera System According to the Present Embodiment 
         [0035]    3. Procedure of a System According to the Present Embodiment 
       1. Technological Basis 
       [0036]      FIG. 1  is a block diagram for illustrating a camera control system in which a camera and a CCU are connected in a one-to-one basis. This camera system is the one used in a studio of a TV station, or the like, in which a CHU  1200  and a CCU  1300  are connected via a camera cable  1100  on a one-to-one basis, and reference signals and video signals are transmitted. The camera system transmits/receives signals, such as video signals or return video signals, among a plurality of the CCU (Camera Control Unit)  1300  as a camera control apparatus, a plurality of the CHU (Camera Head Unit)  1200  connected to each of the CCU  1300  via the camera cable  1100 , and the CCU  1300 , and is configured from a video switcher  1400  for outputting video signals corresponding to the CHU  1200  and the CCU  1300  that have been selected, and a standard signal generator  1500  for outputting a standard signal that is a reference for establishing a video synchronization between each of the CHU  1200  and the CCU  1300 . 
         [0037]    The video switcher  1400  switches the video signals received from each of the CCU  1300  in accordance with selection to output. In order not to distort the video signals at a time of video switching, it is necessary that each of the video signals is synchronized, and that each of the CCU  1300  receives the video signals, which have been synchronized to the reference signal from the standard signal generator  1500 , from the CHU  1200 . The CCU  1300  transmits the reference signal from the standard signal generator  1500  to the CHU  1200 , while the CHU  1200  transmits the video signals synchronized to the reference signal to the CCU  1300 . 
         [0038]    However, although the video signals are synchronized to the reference signal, a timing error occurs in the actual video signals arrived at the video switcher  1400  due to a factor, such as a transmission delay of the camera cable connecting the CHU  1200  and the CCU  1300 , a delay in processing in the CCU  1300 , or the like. Therefore, in an input stage of the video switcher  1400 , a fine adjustment is to be performed for a transmitting timing of the video signals in the CHU  1200  so that the timing of each of the video signals from the each of the CCU  1300  can be matched. This assures an identity of input timings of the video signals transmitted from the CHU  1200 , in the video switcher  1400 . 
         [0039]    The adjustment of the transmitting timing can be performed by a phase regulation in a PLL (Phase Locked Loop) of the CHU  1200  (camera). Performing a delay adjustment by the PLL phase regulation on the side of the camera realizes an adjustment of the input timing of the video signal at low cost and at low power consumption without creating a buffer for the timing adjustment of video data or audio data. However, in this method, range allowed to be delayed from a standard signal form is limited to within one field of the video signal. When a delay adjustment on the side of the CCU  1300  is performed, or when a delay adjustment is performed over one field, a delay adjustment using the buffer for video data and audio data is necessary. 
         [0040]    As described above,  FIG. 1  shows a configuration in which the CHU  1200  and the CCU  1300  are connected via the camera cable on a one-to-one basis, and reference signals and video signals are transmitted. In this configuration, since the factors, such as a transmission delay of the camera cable, the delay in processing in the CCU  1300 , are resolved, it is necessary to perform the timing adjustment. On the other hand, as described before, there exists a method using the asynchronous transmission network for transmission between the CHU  1200  and the CCU  1300 . In the asynchronous transmission network, each of the CCU  1300  and the CHU  1200  transmits the reference signal or the video signal on the same transmission network. In this case, as described before, as the route path is not fixed and the route path varies in accordance with situation, an amount of the timing adjustment of the signals is not to be uniquely defined. Therefore, there is a difficulty in the timing adjustment of the video signals and the audio signals. In light of the foregoing, the present embodiment is aimed to adjust optimally a timing of signals in a camera system using an asynchronous transmission network. 
       2. Configuration Example of a Camera System According to the Present Embodiment 
       [0041]      FIG. 2  is a schematic view for illustrating an example of a camera system using an asynchronous transmission network according to an embodiment. As  FIG. 2  shows, a camera system  100  is configured from a plurality of a CHU (a camera unit)  200 , a CCU (a camera control unit)  300 , a video switcher  400 , and a standard signal generator  500 . The camera and the CCU are connected via an asynchronous transmission network  600 . Note that the present embodiment exemplifies the Ethernet (a registered trademark) as the asynchronous transmission network  600 , however it is not limited to this example. 
         [0042]    When a video transmission is performed using the asynchronous transmission network, since a transmission path varies for each combination of each of the CHU  200  and the CCU  300 , the delay amount will varies. In this case, it is also possible to align arrival timing of video signals in each of the CCU  300  by adjusting timing, similar to the configuration in  FIG. 1  where the CHU  200  and the CCU  300  are connected in a one-to-one basis. However, a route path is not fixed on the asynchronous transmission network  600  and the route path may vary depending on the situation. 
         [0043]    Moreover, in perspective of increasing flexibility in the development of the camera system  100 , it is desired that switching an asynchronous transmission wire such as a LAN cable, or a device such as a switching hub, a router, or the like, for example, can be flexibly accepted. In this case, the individual adjusting timing as described in  FIG. 1  will be difficult to be dealt with. 
         [0044]    Further, by using the asynchronous transmission network  600 , when a failure occurs on the route path currently in use, there is an advantage in developing a redundant configuration against the failure on a transmission device by changing into a different route path. In such a case, it is also difficult to deal with the individual adjusting timing as explained in  FIG. 1 . 
         [0045]    Further, due to a bandwidth limitation of the asynchronous transmission network, it is assumed that transmission may be performed after a video compression (encoding) in the CHU  200 , and the compressed image is to be decompressed (decoding) in the CCU  300 . In this case, it is necessary to take into consideration a delay due to the encoding and decoding, after all, dealing with the individual adjusting timing is associated with difficulties. 
         [0046]    For the reasons described above, a timing adjustment system of the CHU-CCU which is capable of coping flexibly with configuration changes of the camera system  100  is desired in the CHU-CCU camera system which is configured on the asynchronous transmission network  600 . 
         [0047]      FIG. 3  is a schematic view for illustrating the system illustrated in  FIG. 2  in more detail.  FIG. 2  exemplifies the Ethernet (a registered trademark) as the asynchronous transmission network, however, it is not limited to the Ethernet (a registered trademark). The asynchronous transmission network  600  includes a plurality of a switching hub  610 . A plurality of the CHU  200  and a plurality of the CCU  300  are configured so as to correspond with each other on a one-to-one basis, by setting IP address appropriately, for example. Moreover, the reference signal from the standard signal generator  500  is to be transmitted from the CCU  300  to the CHU  200  using the method described in the Patent Literature 2 above or a method of the IEEE1588, or the like. This enables a measurement of the transmission the delay amount between the CHU  200  and the CCU  300 . 
         [0048]    The configuration shown in  FIG. 3  includes a CNU (camera command network unit)  700  in order to adjust a signal delay amount. The CNU  700  has a function for adjusting the signal delay amount. As described later, it is possible not to have the CNU  700 , but to set a certain CCU  300  as a master device so that the CCU  300  of the master device is to adjust the delay amount. 
         [0049]    In the system shown in  FIG. 3 , a structural element  800  which has functions of the CCU  300  and the CNU  700  can be configured by a central processing unit, such as a circuit (hardware) or a CPU, or the like, and a program (software) to function the central processing unit. In this case, the program may be stored in a recording medium, such as a memory included with a structural element such as the CCU  300  or the like, or a memory that is inserted externally, or the like. 
         [0050]      FIG. 4  and  FIG. 5  are schematic views for illustrating a configuration for adjusting the delay amount in detail. A configuration shown in  FIG. 4  corresponds to the configuration in  FIG. 3 , and separately mounts the CNU (camera command network unit)  700  for adjusting the delay amount. The delay amount between the corresponding CHU  200  and the CCU  300  is to be informed from the CCU  300  to CNU  700 . The CNU  700  arbitrates the delay amount to determine the optimal delay amount. The determined delay amount is to be informed through the CCU  300  to the CHU  200 , and the CHU  200  sets up with a video buffer accordingly in order to align timing of video signals reached at each of the CCU  300 . 
         [0051]    The concrete method to determine the delay amount will be explained in detail based on  FIG. 8  later. Note that the CNU  700  is used for the arbitration here, however, another structural element can be used as a device for arbitration in place of the CNU  700 . 
         [0052]      FIG. 5  shows a configuration in which any of the CCU  300  functions as a master device to arbitrate the delay amount without having the CNU  700 . As described above, a certain CCU  300  may be configured to perform function of arbitration without mounting newly an additional device for arbitration. 
         [0053]    As a concrete method to determine the delay amount, there is a method for adjusting the video buffer so that, with respect to the pair of the CHU  200  and the CCU  300  whose delay is the largest, the delay amount of another pair of the CHU  200  and the CCU  300  to be the same. Moreover, based on the delay amount of a certain pair of the CHU  200  and the CCU  300  that is a main camera as a reference, adjustments can be made on video images so that the delay amount of another pair of the CHU  200  and the CCU  300  becomes the same. 
         [0054]    Here, if a reference delay time is Tb, there may be cases such as when the delay amount is less than the reference delay time Tb (the delay amount in this case is assumed as Ts), or when the delay amount is larger than the reference delay time Tb (the delay time in this case is assumed as T 1 ), depending on a pair of the CHU  200  and the CCU  300 . 
         [0055]    In the present embodiment, with regard to the reference delay time Tb of the CHU  200 , adjustments are made on the delay time of another CHU  200 . At this time, as described below, adjustments are made on the delay time so that start timings of frames of the video images are matched with each other. 
         [0056]    Firstly, when the delay amount is less than the reference delay time Tb (the delay amount=Ts), the CCU  300  instructs the CHU  200  to create a video buffer for time Tb−Ts, and adjusts the delay amount of the video image reached at the CCU  300  to be equal to Tb. 
         [0057]      FIG. 6  shows a case where the delay amount Ts of a certain CHU  200  other than the main camera is less than the reference delay time Tb. In this case, as shown  FIG. 6 , video signals of the main camera (the first frame to the fifth frame and more) are delayed for the reference delay time Tb from the reference time. Further, video signals of an arbitrary camera other than the main camera (the first frame to the fifth frame and more) are delayed for Ts (Tb&gt;Ts) from the reference time before delay adjustment. In this case, a video buffer is to be created for time Tb−Ts. Accordingly, as shown in a diagram of a delay amount after adjustment illustrated in the bottom of  FIG. 6 , the delay amount of the video signal of the main camera becomes coincident with the delay amount of the video signal after delay amount adjustment of an arbitrary camera other than the main camera, and a start time of each frame is matched with each other. Therefore, it is possible to surely avoid distortion of the video images at a time of switching the signals by the video switcher. 
         [0058]    Further,  FIG. 7  shows a case where a delay amount T 1  of a certain CHU other than the main camera is larger than the reference delay time Tb. In this case, as shown  FIG. 7 , video signals of the main camera (the first frame to the fifth frame and more) are delayed for the reference delay time Tb from the reference time. Further, video signals of an arbitrary camera other than the main camera (the first frame to the fifth frame and more) are delayed for T 1  (T 1 &gt;Tb) from the reference time before delay adjustment. In this case, a video buffer is to be created for time (Tb+n*Tfr)−T 1 . Here, Tfr is time for 1 frame, and n is to be defined so as to be (Tb+n*Tfr)−T 1 . In  FIG. 7 , n=1 is to be set. Accordingly, as shown in a diagram of a delay amount after adjustment in the bottom of  FIG. 7 , although a certain frame of the video signal of the main camera is shifted for one frame from the corresponding frame of the video signal of a certain camera other than the main camera, the start time of each frame is matched with each other. Therefore, it is possible to surely avoid distortion of the video images at a time of switching the signals by the video switcher. Note that in  FIG. 7 , it is assumed that n=1 since the start time of the first frame of cameras other than the main camera is earlier than the start time of the second frame of the main camera, however, if the start time of the first frame of cameras other than the main camera is later than the start time of the second frame of the main camera and earlier than the start time of the third frame of the main camera, it is assumed that n=2. Accordingly, although a certain frame of the video signal of the main camera is shifted for two frames from the corresponding frame of the video signal of a certain camera other than the main camera, the start time of each frame is matched with each other, and so it is possible to avoid distortion of the video images. 
         [0059]    As described above, if the delay amount (T 1 ) is larger than the reference delay time Tb, the CCU  300  instructs the CHU  200  to create a video buffer for time (Tb+n*Tfr)−T 1 , and adjusts so that the delay amount of the video reached at the CCU  300  is delayed for n frames from the reference delay Tb. 
         [0060]    Further, regarding the CHU  200 , the CCU  300 , the CNU  700  or the video switcher  400  or the like, which are delayed for n-frames from the pair as a reference of the CHU  200  and the CCU  300 , there is a function to display that a pair of the CHU  200  and the CCU  300  is delayed for n-frames. 
       3. Procedure of a System According to the Present Embodiment 
       [0061]      FIG. 8  is a flowchart for illustrating a procedure of the system according to the present embodiment. A flow of processing from activating the system power or resetting the system to determining the video buffer will be explained as below. Here, as shown in  FIG. 3  and  FIG. 4 , an explanation will be given on a case where the CNU  700  is set for arbitration. 
         [0062]    Firstly, in step S 10 , activation of the system or resetting the system is performed. When a change is made in the configuration of the asynchronous transmission network  600  (the number of the switching hub  610 , etc.), when a change is made in the number of CHU  200 , or the like, a calibration is performed for a whole system by a system reset. In the subsequent step S 12 , synchronization is established between each of the CHU  200  and the CCU  300 . In the subsequent step S  14 , delay time is measured for each of the pair of the corresponding CHU  200  and CCU  300 . Measuring the delay time can be performed along with establishing synchronization in step S 12 , using the method described in the Patent Literature 2 described above, the method of the IEEE1588, or the like. Specifically, the delay time is to be measured by comparing the timing of the video signal obtained in each of the CCU  300  and a reference pulse generated in the standard signal generator  500 . In the subsequent step S 16 , each of the CCU  300  notifies the CNU  700  of the delay time. In the subsequent step S 18 , the CNU  700  selects the delay time Tb that has been notified from the CCU  300  corresponding to the CHU  200  which has been set up as a main camera in advance. 
         [0063]    In the subsequent step S 20 , a determination is to be made on whether the delay time notified from each of the CCU  300  corresponding to each of the CHU  200  other than the main camera is larger than the delay time Tb selected in step S 18 . 
         [0064]    If the delay time notified from each of the CCU  300  corresponding to each of the CHU  200  other than the main camera is larger than the delay time Tb in step S 20 , it proceeds to step S 22 . At this time, it is assumed that the delay time notified from each of the CCU  300  corresponding to the each of the CHU  200  other than the main camera is T 1 . In step S 22 , the CNU  700  calculates a time (Tb+n*Tfr)−T 1 , and notifies the CCU  300  of the calculated time. Here, each of the CCU  300  whose delay time is larger than the delay time Tb is to be notified of the time (Tb+n*Tfr)−T 1 . 
         [0065]    Subsequently, in step S 26 , the video buffer size corresponding to the time (Tb+n*Tfr)−T 1  is to be calculated. In the subsequent step S 28 , the buffer size calculated in step S 26  is to be transmitted to the corresponding CHU  200 . Accordingly, the CHU  200  creates a buffer in the memory for accumulating video signals based on the indicated buffer size, and adjusts timing of the signals. Subsequently, as explained in  FIG. 7 , the delay amount of the CCU  300  whose delay time is T 1  is to be adjusted to a state of being delayed for n-frames from the main camera. The processing will end after step S 28 . 
         [0066]    Further, in step S 24 , information that there is a delay for n-frames is to be displayed in the CCU  300 , the CNU  700 , the CHU  200 , the video switcher  400 , or the like. At this time, the information that there is the delay for n-frames is transmitted from the CNU  700  to the CCU  300 , the CHU  200 , and the video switcher  400 . Then, the CCU  300 , the CHU  200 , and the video switcher  400  perform a display based on the information that has been transmitted. 
         [0067]    Moreover, in step S 20 , if the delay time is less than the delay time Tb that has been calculated in step S 18 , it proceeds to step S 30 . In step S 30 , time Tb−Ts is calculated to notify the CCU  300 . Here, the time Tb−Ts is notified to each of the CCU  300  whose delay time is less than the delay time Tb. In the subsequent step S 32 , each of the CCU  300  calculates video buffer size corresponding to the time Tb−Ts. In the subsequent step S 34 , each of the CCU  300  instructs the buffer size calculated in step S 32  to each of the CHU  200 . The CHU  200  adjusts the timing of signals based on the buffer size. The processing will end after step S 32 . Subsequently, the CHU  200  creates a buffer in the memory for accumulating video signals based on the indicated buffer size, and adjusts timing of the signals. As explained in  FIG. 6 , this makes the delay amount of the CCU  300  whose delay time has been Ts adjusted to be matched with the reference delay amount Tb of the main camera. The processing will end after step S 34 . 
         [0068]    Note that in the explanations described above, a video buffer that adjusts the delay amount is created in the CHU  200 , however, the video buffer can be created in the CCU  300 . Also, when the adjusting delay is performed in the CHU  200 , the delay amount can be configured not by the buffer, but by the PLL phase regulation. Further, the adjusting delay can be realized using both a buffer and PLL phase regulation. 
         [0069]    As described above, according to the present embodiment, it is possible to surely synchronize signals from each of the CHU  200  in a system which can make the transmission path simpler, reduce the cost, and develop a complex camera system with few wiring, by using the asynchronous transmission network. Therefore, it is possible to surely avoid distortion of video signals or audio signals when the video images that have been imaged in the each of the CHU  200  are switched. Further, using the asynchronous transmission network makes the flexibility in changing a camera network increased, and adapting a bus wiring makes the flexibility in wiring increased which leads to increase the flexibility in switching cameras and CCU. Further, by changing a destination address (IP address), it is possible to easily switch a camera (CHU  200 ) and the CCU  300 . 
         [0070]    A preferred embodiment of the present invention has been explained in detail above with reference to the attached drawings, the present invention is not limited to this example. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and alterations may occur depending on design requirements and other factors insofar as they are within the scope of the appended claims or the equivalents thereof.

Technology Category: 5