Abstract:
An endoscopic video system that provides for multiple differing inputs from a plurality of different attached devices types including, for example, High-Definition and Standard-Definition signals, the camera control automatically sensing and configuring itself based upon the connected devices (e.g. camera and display). The system further provides for scaling of input and output signals depending as necessary.

Description:
FIELD OF THE INVENTION 
       [0001]    The invention relates to a multi-function camera control unit, and more particularly, to a camera control unit that is capable of receiving inputs from multiple different types of cameras having diverse signal formats and may generate diverse output signals compatible with differing displays. 
       BACKGROUND OF THE INVENTION 
       [0002]    A Camera Control Unit (“CCU”) is generally used in conjunction with a camera to capture and process images. The camera may include charge couple devices (“CCD”), CMOS devices or any other type of image capture device. They are typically used in conjunction with an endoscope to generate image data of an area to be viewed during a procedure. The image data is transmitted to the CCU. The CCU then processes the image data into displayable image data to be sent to a display. The CCU may also send commands to the camera in order to operate and adjust camera settings. 
         [0003]    Known CCUs typically control a single type of camera by receiving and processing image data generated by the camera. The CCU controls the camera by adjusting color balance, light, focal distance, resolution, zoom, focus, shading, and other typical optical characteristics. 
         [0004]    Traditionally, CCUs have been compatible with a limited number of devices because the control unit hardware, through which commands were sent and image signals were received, was difficult to configure to communicate with the many different types of devices in the market. For example, different devices may have varying electronic requirements/connections in order to function properly. Devices may be either analog or digital. In addition, some types of cameras are designated to pick up certain colors such as red or green while others pick up blue. In addition, as changes and improvements are made to devices, a control unit&#39;s hardware, which was configured to be compatible with older devices, may become incompatible and may need to be upgraded as well. 
         [0005]    Because a CCU was compatible with limited quantities of devices, older CCUs were typically discarded in favor of CCUs that were made concurrently with particular devices. In order to address compatibility problems, configurable CCUs were introduced to function with a number of differing camera types. 
         [0006]    For example, U.S. Pat. No. 5,627,583 (“Nakamura et al.”) relates to an electroendoscope system that is compatible with a plurality of different endoscope types. However, Nakamura et al. fails to teach, disclose or suggest a system that is compatible with fundamentally differing signal types, such as for instance, a standard definition and a high-definition signal format. In addition, Nakamura et al. fails to teach or suggest a system that is compatible or usable with numerous differing display types, such as for instance, standard definition and high-definition displays. Therefore, while Nakamura et al. does provide for some versatility with regard to the attached camera, e.g. can configure itself to control the attached camera and receive the generated image signal, the CCU taught in Nakamura et al. is still limited to being able to receive a single type of image signal input (e.g. an analog input) and a single image signal format output (See, Col. 3, In. 60—Col. 4, In. 4; Col. 4, Ins. 58-67). 
       SUMMARY OF THE INVENTION 
       [0007]    What is desired, therefore, is to provide a system and method that is capable of maintaining compatibility different devices that may have fundamentally different signal formats. 
         [0008]    It is also desired to provide a system and method that can automatically detect the type of device attached and can then automatically configure itself to be compatible with and control the attached device. 
         [0009]    It is further desired to provide a system and method that is compatible with many different types of displays. 
         [0010]    It is still further desired to provide a system and method that can automatically detect the type of connected display and can then automatically configure itself to be compatible with and control the attached display. 
         [0011]    It is yet further desired to provide a system and method that can receive information from a connected device and automatically detect whether the received information is most up-to-date information for the attached device and if not, provide upgraded information to the attached device. 
         [0012]    It is still further desired to provide a system and method that can accept either a standard or a high definition input signal from an input device and provide either a standard or a high definition output signal for an attached output device. 
         [0013]    These and other objects are achieved in one advantageous embodiment in which a video imaging system is provided including a CCU the can automatically sense and identify a connected device, such as a camera, the CCU configuring and/or programming itself based on the identified device. A camera is provided to receive reflected light from an area to be viewed and for generation of image data representative of the reflected light. There are many different types of cameras and a number of different signal formats for the image data including, for example, Standard Definition (SD) and High Definition (HD) signals. In order to configure itself, the CCU retrieves and/or receives a program or multiple programs stored on a storage device. The retrieved program(s) execute on the camera control unit for enabling the camera control unit to process the image data. The digital input signal from an attached camera can vary widely, for example they may include but not are limited to ranges from 200×200 pixel resolution to 1920×1080 pixel resolution. 
         [0014]    It is contemplated that the storage device may be any type of storage medium accessible by the control unit. For instance, it may be an internal, external, or removable drive and may also include a remote location, such as an Internet location. The storage device may also be located within the camera and/or the CCU. It is further contemplated that multiple storage devices and/or locations may be used to provide the latest version of software and/or programs for the configurable control unit. 
         [0015]    In addition, the CCU also senses and identifies a connected display and configures an output signal to be compatible with the identified display. The output signal may variously be compatible with, for example, NTSC or PAL formats and may be provided as an SD or an HD signal. In addition to providing a compatible video signal output to an attached display, the CCU configures output control signals to properly control the attached display. 
         [0016]    The CCU may be provided as a field programmable gate array (e.g. a configurable hardware device) or may be provided as a microprocessor or a Digital Signal Processor (DSP) (e.g. a soft configurable device). In any event, the CCU detects and identifies the connected device, e.g. a particular camera and/or a particular display, storage or other device, and configures itself to be compatible with the connected devices both for function and control. To function properly with a camera, the CCU will configure itself so as to be able to receive image data from and to be able to send command signals to the camera to control, for example, the camera&#39;s optical functional characteristics including: focal distance, resolution, light balance or color and the like. 
         [0017]    In one advantageous embodiment, the CCU is provided with a microprocessor that receives a processor program for programming the microprocessor and a device program for programming and / or configuring the configurable device to process the received image data. 
         [0018]    The term “data” as used herein means any indicia, signals, marks, symbols, domains, symbol sets, representations, and any other physical form or forms representing information, whether permanent or temporary, whether visible, audible, acoustic, electric, magnetic, electromagnetic or otherwise manifested. The term “data” as used to represent predetermined information in one physical form shall be deemed to encompass any and all representations of the same predetermined information in a different physical form or forms. 
         [0019]    The term “network” as used herein includes both networks and internetworks of all kinds, including the Internet, and is not limited to any particular network, inter-network, or intra-network. 
         [0020]    The terms “coupled”, “coupled to”, and “coupled with” as used herein each mean a relationship between or among two or more devices, apparatus, files, programs, media, components, networks, systems, subsystems, and/or means, constituting any one or more of (a) a connection, whether direct or through one or more other devices, apparatui, files, programs, media, components, networks, systems, subsystems, or means, (b) a communications relationship, whether direct or through one or more other devices, apparatui, files, programs, media, components, networks, systems, subsystems, or means, and/or (c) a functional relationship in which the operation of any one or more devices, apparatui, files, programs, media, components, networks, systems, subsystems, or means depends, in whole or in part, on the operation of any one or more others thereof. 
         [0021]    In one advantageous embodiment, a video endoscopic system is provided comprising, a camera for generating image data and a display for displaying the image data. The system further comprises a camera control unit coupling the camera to the display. The camera control unit has a first input for transmitting and receiving a first signal format and a second input for transmitting and receiving a second signal format that is different from the first signal format. The camera control unit also has an output for transmitting the image data to the display. 
         [0022]    In another advantageous embodiment, a method for transmitting image data from multiple cameras having differing signal formats to a camera control unit and a display is provided comprising the step of providing, a first receptacle and a second receptacle in the camera control unit, the first receptacle having a first configuration and the second receptacle having a second configuration that is different from the first configuration. The method further comprises the steps of providing a camera having one of either a first plug configuration or a second plug configuration that couples to the first and second receptacle configurations respectively, coupling the camera to one of the first or second receptacles and receiving a camera identifier and a program. The method still further comprises the steps of configuring the camera control unit based on the camera identifier and received program, coupling the camera control unit to the display and receiving a display identifier. Finally, the method comprises the steps of configuring an output signal to be compatible with the connected display, transmitting image data to the display and displaying the image data on the display. 
         [0023]    Other objects of the invention and its particular features and advantages will become more apparent from consideration of the following drawings and accompanying detailed description. 
     
    
     
       BRIEF DESCRIPTION OF THE DRAWINGS 
         [0024]      FIG. 1  is a block diagram of one advantageous embodiment of the present invention. 
           [0025]      FIG. 2  is a block diagram of the advantageous embodiment according to  FIG. 1 . 
           [0026]      FIG. 3  is a block diagram of the advantageous embodiment according to  FIG. 1 . 
           [0027]      FIG. 4  is a block diagram of the advantageous embodiment according to  FIG. 1 . 
           [0028]      FIG. 5  is an illustration of the Camera Control Unit according to the advantageous embodiment of  FIG. 1 . 
           [0029]      FIG. 6  is an illustration of the Camera Control Unit according to the advantageous embodiment of  FIG. 1 . 
           [0030]      FIG. 7  is an illustration of input and output dimension for HD project resampling for NTSC. 
           [0031]      FIG. 8  is an illustration of input and output dimension for HD project resampling for PAL. 
       
    
    
     DETAILED DESCRIPTION OF THE INVENTION 
       [0032]    Referring now to the drawings, wherein like reference numerals designate corresponding structure throughout the views. 
         [0033]      FIG. 1  depicts a system  100  comprising a camera  104  for generating image data. Camera  104  is connected to camera control unit  102  via a coupling  116 . The coupling  116  is provided to supply electrical power to camera  104  as well as to transmit data between camera  104  and camera control unit  102 . Camera control unit  102  is provided with at least two different inputs, including, a High-Definition (HD) Input  108  and a Standard-Definition (SD) Input  110 . As used in this application, SD generally refers to a line count of up to approximately 720×480 NTSC and PAL; while HD refers to systems that utilize a higher line count and may include, for example but not limited to, 1280×720 progressive or 1920×1080 or interlaced, which are only two of the commonly used HD resolutions. Depending on the camera type (SD or HD) a user will attach the camera to either the HD input  108  or the SD input  110 . 
         [0034]    Also shown in  FIG. 1  is processor/configurable device  128  shown in camera control unit  102 . Based on the connected camera, the camera control unit  102  will be configured to function with the connected camera  104  via either the HD input  108  or the SD input  110 . 
         [0035]    Two different output types are illustrated in  FIG. 1  including, HD output  112  and SD output  114 . It is contemplated that a display  106  may be connected to camera control unit  102  via a coupling  118 . Upon connection, the camera control unit  102  can detect the attached display  106  and determine the correct signal format for proper functioning of display  106 . For example, display  106  may be designed to display only SD video signals. That being the case, camera control unit  102  will transmit an SD signal format to display  106  whether an SD or an HD camera is connected. Alternatively, it may be determined that the connected display  106  may be designed to display HD video signals. In this case, if the connected camera  104  is an HD camera, an HD signal is transmitted to display  106 . If however, an SD camera  104  is connected to camera control unit  102 , an enhanced SD signal may be transmitted to the HD display  106 . In this manner the following signal format types may be used SD input →SD output ; SD input →Enhanced SD output ; HD input →SD output ; and HD input →HD output . It should be noted that categorization of inputs and outputs as SD or HD is not intended to limit the categories to a single signal format, but rather, many differing signal formats may be categorized as SD and many differing signal formats may be categorized as HD. 
         [0036]    It is contemplated that configuration information for either camera  104  and / or display  106  may be located on camera  104  and display  106  respectively. Alternatively, configuration information may be located in storage  126  that may comprise an internal storage device for camera control unit  102  with camera  104  and display  106  providing an identifier for camera control unit  102  to look up the correct configuration information. Still further, configuration information may be remotely located and may be transmitted to camera control unit  102  via a line  120  over a network connection  122  from a remote storage  124 . The network connection  122  may include, for example, an Intranet, the Internet and/or the like. 
         [0037]    Referring now to  FIG. 2 , an advantageous embodiment of the interaction between camera  104  and camera control unit  102  is illustrated. For example, upon connection of camera  104  to camera control unit  102 , a camera identifier/program  130  stored on camera  104  may be transmitted as camera information/program(s)  132  to camera control unit  102 . It is contemplated that the camera identifier may comprise discrete data or may comprise a program. In addition, it is contemplated that one or more programs may be stored on camera  104  and transmitted as or with the camera identification data. The processor and/or configurable device  128  receives the camera information/program(s) and executes the program(s)  142 , which allows the processor and/or configurable device  128  to receive and process image data generated and transmitted by camera  104 . 
         [0038]    It is further contemplated that one or more programs may be located on internal storage  126  or may be located on remote storage  124 . For example, upon connection of camera  104  to camera control unit  102 , camera identifier  130  may be transmitted to camera control unit  102 . Once identified, a program(s) may be transmitted to processor and/or configurable device  128  from camera  104 , internal storage  126  or remote storage  124 . 
         [0039]    Once processor and/or configurable device  128  is properly configured to function with camera  104 , camera control unit  102  may issue commands  134  to camera  104 , for example, to adjust color balance, light, focal distance, resolution, zoom, focus, shading, and other optical characteristics. Camera  104  may then generate and transmit image data  136 , which is received and processed by camera control unit  102 . Image data received and processed by camera control unit  102  is then transmitted in the proper signal format to display  106 . 
         [0040]    Also illustrated in  FIG. 2  is light path  138 , 140  and light source  144 . It is contemplated that light source  144  may comprise virtually any type of commonly used light source including, for example, a Light Emitting Diode while the light path may comprise, for instance, a coherent or non-coherent fiber optic bundle. While the light path  138 , 140  is illustrated passing through camera control unit  102 , it is contemplated that the light path may be separate and apart from camera control unit  102 . Additionally, it is contemplated that light path  138  may be combined into coupling  116  or light source  144  may be provided in camera  104 , or camera control unit  102 . 
         [0041]      FIG. 3  illustrates still another advantageous embodiment of the present invention. In this embodiment, display identifier  146  stored on display  106  is transmitted as display identification  148  to camera control unit  102 . Once received, camera control unit  102  will determine a signal format that will be compatible with display  106 . Image data  150  will then be transmitted to display  106  in the properly configured signal format. 
         [0042]    There are commonly used types of signal formats that are typically used, however, it is contemplated that additional formats may be provided for and especially new signal formats that may become available. The two commonly used SD format types are NTSC and PAL. It should be noted that these are just two video signal formats and that there are many differing types and modifications to the above-listed types including, for example, a modified version Phase-Alternating Line (PAL-M). In any event, upon receipt of display information  148 , camera control unit  102  can retrieve information and/or a program from, for example, internal storage  126 , remote storage  124  or even from display  106  for configuration of the output signal for sending image data  150  in the proper format. 
         [0043]    A number of examples will be provided of the input and output dimensions for HD resampling of NTSC and PAL formats. The following examples are presented to further illustrate and explain the present invention and should not be taken as limiting in any regard. 
       EXAMPLE 1 
     For NTSC the Specifications in one Advantageous Embodiment are as Follows 
       [0000]    
       
         
           
             Active data: 484×756 
             Pixel dimensions: 4.75 H×5.55 V 
             FPS: 60/1.001=59.9401
 
Data stream (input and output) is running at 147.2727 MHz.
 
           
         
       
     
         [0047]    Dimensions of total input data (active and inactive). Total number of input lines: 525. To find the total number of pixels per line: in 1 second there are 145.2727×10 6  pixels. Also, in  1  second there are 60/1.001 frames of (525×total number of pixels per input line (145.2727×10 6 /((60/1.001)×525)=4680. 
         [0048]    Dimensions of total output data (active and inactive). Total number of output lines: 1125. We can use the fact that the input and output frame correspond to the same frame time. The total number of pixels per output line is then: (525×4680)/1125=2184. 
         [0049]    Dimensions of active input data. Out of a total of 525 lines, we assume that 483 contain valid data (active lines). The number of input active lines is: 483. The number of pixels per active line is: 756 oversampled by 2=1512. The active lines need to be resampled (vertically) by a factor of 1125/525. The number of output lines is: 483×1125/525=1035. It should be noted that, in this case, 1125/525 gives an integer value so we can work with; 1125/525 or 1035/483. Otherwise, the active line ratio should be used. To determine the number of output pixels, we consider the ratio of vertical resampling as well as the fact that the pixels need to be converted to square dimension. The number of output square pixels=(1512/2×(4.75H/5.55V))×(1035/483)=1386.5˜1386.  FIG. 7  illustrates these numbers. 
       EXAMPLE 2 
     For PAL the Specifications in one Advantageous Embodiment are as Follows 
       [0000]    
       
         
           
             Active data: 576×742 
             Pixel dimensions: 4.85 H×4.65 V 
             FPS: 50 (exactly)
 
Data stream (input and output) is running at 127.6875 MHz.
 
           
         
       
     
         [0053]    Dimensions of total input data (active and inactive). Total number of input lines: 625. To find the total number of pixels per line: in 1 second there are 127.6875×10 6  pixels. Also, in 1 second there are 50 frames of (625×total number of pixels per input line (127.6875×10 6 /(50×625)=4086. 
         [0054]    Dimensions of total output data (active and inactive). Total number of output lines: 1125. We can use the fact that the input and output frame correspond to the same frame time. The total number of pixels per output line is then: (625×4086)/1125=2270. 
         [0055]    Dimensions of active input data. Out of a total of 625 lines, we assume that 573 contain valid data (active lines). The number of input active lines is: 575. The number of pixels per active line is: 742 oversampled by 2=1484. The active lines need to be resampled (vertically) by a factor of 1125/625. The number of output lines is: 575×1125/625=1035. To determine the number of output pixels, we consider the ratio of vertical resampling as well as the fact that the pixels need to be converted to square dimension. The number of output square pixels=(1484/2×(4.85H/4.65V))×(1035/575)=1393.  FIG. 8  illustrates these numbers. 
         [0056]    In addition to the standard NTSC and PAL SD (NTSC and PAL) composite, RGB, and s-video (Y/C) outputs, numerous other outputs may be used. The following examples are presented to further illustrate and explain the present invention and should not be taken as limiting in any regard. 
         [0057]    Serial Digital Interface (SDI), standardized in ITU-R BT.656 and SMPTE 259M, is a digital video interface used for broadcast-grade video. A related standard, known as High Definition Serial Digital Interface (HD-SDI), is standardized in SMPTE 292M and provides a nominal data rate of 1.485 Gbit/s. 
         [0058]    Digital Visual Interface (DVI) is a video interface standard designed to maximize the visual quality of digital display devices such as flat panel LCD computer displays and digital projectors and is partially compatible with the HDMI standard in digital mode (DVI-D). The DVI interface uses a digital protocol in which the desired illumination of pixels is transmitted as binary data. When the display is driven at its native resolution, it will read each number and apply that brightness to the appropriate pixel. In this way, each pixel in the output buffer of the source device corresponds directly to one pixel in the display device. 
         [0059]    High-Definition Multimedia Interface (HDMI) is an all-digital audio/visual interface capable of transmitting uncompressed streams. HDMI is compatible with High-bandwidth Digital Content Protection (HDCP) Digital Rights Management technology. HDMI provides an interface between any compatible digital audio/video source and a compatible digital audio and/or video monitor, such as a digital television (DTV). 
         [0060]    Referring now to  FIG. 4  it is contemplated that a storage device for storing the program(s) for configuration of the processor and/or configurable device  128  may reside on camera  104 , internal storage  126 , a removable storage  154  (e.g. a removable drive or storage medium) or a remote storage  124  (e.g. via a network connection). In this manner, when the camera control unit  102  receives the camera identification/program(s)  132  from camera  104 , camera control unit  102  can compare program(s) versions from the various storage mediums to determine if the camera identification/program(s) received from camera  104  is the latest version and if not, the camera information can be updated. This can happen automatically, or the system could, for example, prompt the user to decide whether or not to update the camera information. In addition, it is contemplated that based upon user access, certain programs and/or features may become available. 
         [0061]      FIGS. 5 and 6  illustrate the camera control unit  102  per one embodiment of the present invention. Camera control unit  102  includes a case  160  having a front panel  162 . Front panel  162  is provided with multiple inputs including, an HD receptacle  164  and an SD receptacle  166 . In addition, a power switch  168  may also be positioned on front panel  162 . Also positioned on front panel  162  is slideable door  170  and tracks  172 . It is contemplated that a camera  104  is provided with a plug (not shown) that, based upon the camera configuration (e.g. either HD or SD), is keyed to fit in either HD receptacle  164  or SD receptacle  166 . The door  170  may simply be slid to cover the receptacle that is not currently in use. The door is provided with a protrusion(s) (not shown) that engage with a channel  174  provided in tracks  172  so as to capture door  170  but still allow for lateral sliding action. 
         [0062]    It should be noted that, while HD receptacle  164  and SD receptacle  166  are not illustrated including an optical connection or coupling, it is contemplated that they may be provided with such. 
         [0063]    Although the invention has been described with reference to a particular arrangement of parts, features and the like, these are not intended to exhaust all possible arrangements or features, and indeed many other modifications and variations will be ascertainable to those of skill in the art.