Abstract:
An image processing device, method and computer program product cooperate to make adjustments in detection area for image adjustment processing to when displacement adjustments have been made to a first or second imaging area. A detection area setting device sets a first detection area within a first imaging area and sets a second detection area in a second imaging area after a displacement adjustment is applied to at least one of the first imaging area and the second imaging area. The first detection area is an area used in image adjustment processing.

Description:
TECHNICAL FIELD 
       [0001]    The present disclosure relates to an image processing device, an image processing method and an image processing computer program product that are suitably applied to a compound eye imaging device that captures so-called stereoscopic images using, for example, two cameras. 
       BACKGROUND ART 
       [0002]    In recent years, a method is proposed that obtains a stereoscopic effect using stereoscopic viewing (stereovision) in which images of two viewpoints, namely left and right (stereoscopic images) are seen, respectively, by the left and right eye. 
         [0003]    As a method to generate image signals used in the stereoscopic viewing, compound eye imaging is known, in which two cameras are arranged on the left and the right, and images of the two viewpoints are captured, respectively. 
         [0004]    On the other hand, with respect to a normal imaging device using one camera, a method is known in which a central portion of a screen based on image signals is segmented in a rectangular shape as a detection area (detection frame) (refer to Patent Literature 1, for example). With this type of imaging device, predetermined arithmetic processing is applied to values of pixel signals included in the detection area, a signal for image adjustment is thus generated for automatic focus etc. and the image is actually adjusted based on that signal. 
       CITATION LIST 
     Patent Literature 
       [0005]    PTL 1: JP H11-98407A 
       SUMMARY 
     Technical Problem 
       [0006]    However, when performing compound eye imaging, it is conceivable that detection areas are set for each of images captured using two cameras, for example, signals for image adjustment are generated using the values of the pixel signals included in each of the detection areas, and each of the images are then adjusted. 
         [0007]    At this time, it is assumed that each of the detection areas is set to be in a central section of each of the images. For example, when a specific imaging target (subject) is positioned in the center of each of the images, each of the detection areas is set such that they are all matched up with the subject. 
         [0008]    Meanwhile, in a stereoscopic image, it is known to be possible to adjust a degree of the stereoscopic effect, which is obtained by adjusting areas of images that are mutually captured by two cameras, namely, by adjusting a degree of displacement between captured areas. 
         [0009]    However, when the captured areas are displaced, the position of the detection areas on the screen does not change from the central section of the screen, and thus the detection areas are displaced from the subject. As a result, there is a risk that a focus cannot be aligned on the subject. 
         [0010]    In this type of compound eye imaging, when the captured area is changed in accordance with adjustment of the stereoscopic effect, there is a problem that the image cannot be appropriately adjusted. 
         [0011]    The present disclosure has been made in light of the above-described problems, and provides an image processing device, an image processing method and an image processing program that are capable of appropriately adjusting a plurality of respective images. 
       Solution to Problem 
       [0012]    In one exemplary embodiment, an image processing device including a detection area setting device that sets a first detection area within a first imaging area and sets a second detection area in a second imaging area after a displacement adjustment is applied to at least one of the first imaging area and the second imaging area. The first detection area being an area used in image adjustment processing. 
         [0013]    According to one aspect of the embodiment, the image processing device, further includes a displacement adjustment mechanism that compensates for optical mis-alignment between a first imaging unit and a second imaging unit. 
         [0014]    According to another aspect of the embodiment, the image processing device, further includes a zoom lens; and a lens control portion. The displacement adjustment mechanism compensates for optical misalignment caused by zoom adjustment of the zoom lens. 
         [0015]    According to another aspect of the embodiment, the image processing device, further includes a storage device. Adjustment amounts used by the displacement adjustment mechanism to adjust for misalignment are predetermined and stored in the storage device. 
         [0016]    According to another aspect of the embodiment, the adjustment amounts are optical axis correction amounts, and the storage device stores the optical axis correction amounts in an optical axis correction table. 
         [0017]    According to another aspect of the embodiment, the image processing device, further includes the first imaging unit and the second imagining unit, wherein the first imaging unit, the second imagining unit, and the detection area setting device are part of a compound eye imaging device. 
         [0018]    According to another aspect of the embodiment, the image adjustment processing being one of focus control, exposure control and white balance control. 
         [0019]    According to another aspect, the first detection area is positioned in a center of the first imaging area, and the second detection area is positioned in a center of the second imaging area. 
         [0020]    According to another aspect, the detection area setting device sets a third imaging area and a forth imaging area, the third imaging area being an area created by moving the first imaging area in a horizontal direction, and a fourth imaging area being an area created by moving the second imaging area in an opposite horizontal direction, an amount of movement for the first imaging area and the second imaging area corresponding to a stereoscopic effect. 
         [0021]    According to a method embodiment, the method includes applying a displacement adjustment to at least one of a first imaging area and a second imaging area, and setting with a detection area setting device, a first detection area within the first imaging area, and a second detection area in the second imaging area. The first detection area being an area used in image adjustment processing. 
         [0022]    One aspect of this embodiment is that it may include compensating for optical mis-alignment between a first imaging unit and a second imaging unit with a displacement adjustment mechanism. 
         [0023]    Another aspect is that it may include adjusting a zoom on a zoom lens. The compensating includes compensating for optical misalignment caused by the adjusting of the zoom. 
         [0024]    Another aspect is that it may include storing in a storage device adjustment amounts used by the displacement adjustment mechanism to adjust for misalignment between the first imaging unit and the second imagining unit. 
         [0025]    Another aspect is that the adjustment amounts are optical axis correction amounts, and the storage device stores the optical axis correction amounts in an optical axis correction table. 
         [0026]    Another aspect is that the image adjustment processing being one of focus control, exposure control and white balance control. 
         [0027]    According to another aspect, the first detection area as positioned in a center of the first imaging area, and the second detection area is positioned in a center of the second imaging area. 
         [0028]    According to another aspect, the setting includes setting a third imaging area and a forth imaging area, the third imaging area being an area created by moving the first imaging area in a horizontal direction, and a fourth imaging area being an area created by moving the second imaging area in an opposite horizontal direction, an amount of movement for the first imaging area and the second imaging area corresponding to a stereoscopic effect. 
         [0029]    In a non-transitory computer readable storage device embodiment that has instructions stored thereon that when executed by a processing circuit implement an image processing method, the method includes applying a displacement adjustment to at least one of a first imaging area and a second imaging area; and setting with a detection area setting device a first detection area within the first imaging area, and a second detection area in the second imaging area. The first detection area being an area used in image adjustment processing. 
         [0030]    According to one aspect of the embodiment, the embodiment includes compensating for optical misalignment between a first imaging unit and a second imaging unit with a displacement adjustment mechanism. 
         [0031]    Another aspect is that it may include adjusting a zoom on a zoom lens. The compensating includes compensating for optical misalignment caused by the adjusting of the zoom. 
         [0032]    Another aspect is that it may include storing in a storage device adjustment amounts used by the displacement adjustment mechanism to adjust for misalignment between the first imaging unit and the second imagining unit. 
         [0033]    Another aspect is that the adjustment amounts are optical axis correction amounts, and the storage device stores the optical axis correction amounts in an optical axis correction table. 
         [0034]    Another aspect is that the image adjustment processing being one of focus control, exposure control and white balance control. 
         [0035]    According to another aspect, the first detection area is positioned in a center of the first imaging area, and the second detection area is positioned in a center of the second imaging area. 
         [0036]    According to another aspect, the setting includes setting a third imaging area and a forth imaging area, the third imaging area being an area created by moving the first imaging area in a horizontal direction, and a fourth imaging area being an area created by moving the second imaging area in an opposite horizontal direction, an amount of movement for the first imaging area and the second imaging area corresponding to a stereoscopic effect. 
       ADVANTAGEOUS EFFECTS OF INVENTION 
       [0037]    According to the present disclosure, it is possible to adjust each of images using an image signal that is extracted taking a first area as reference, irrespective of a degree of stereoscopic effect, because it is possible to set a second area in accordance with the stereoscopic effect that is wished to be conveyed while also being possible to set a detection area based on the first area, without reference to the second area. Thus, the present disclosure can realize an image processing device, an image processing method and an image processing program that are capable of appropriately adjusting a plurality of respective images. 
     
    
     
       BRIEF DESCRIPTION OF DRAWINGS 
         [0038]      FIG. 1  is a schematic diagram that shows an overall configuration of a compound eye imaging device. 
           [0039]      FIG. 2  is a schematic diagram that shows a hardware configuration of a system controller. 
           [0040]      FIG. 3  is a schematic diagram that shows a functional configuration of the system controller and a digital signal processing portion. 
           [0041]      FIG. 4  is a schematic diagram that shows extraction areas and detection areas of images according to a first embodiment. 
           [0042]      FIG. 5  is a schematic diagram that shows relationships between images and detection areas according to the first embodiment. 
           [0043]      FIG. 6  is a flowchart that shows a right side detection area setting processing procedure according to the first embodiment. 
           [0044]      FIG. 7  is a flowchart that shows a left side detection area setting processing procedure according to the first embodiment. 
           [0045]      FIG. 8  is a schematic diagram that shows extraction areas and detection areas of images according to a second embodiment. 
           [0046]      FIG. 9  is a schematic diagram that shows relationships between images and detection areas according to the second embodiment. 
           [0047]      FIG. 10  is a flowchart that shows a right side detection area setting processing procedure according to the second embodiment. 
           [0048]      FIG. 11  is flowchart that shows a left side detection area setting processing procedure according to the second embodiment. 
       
    
    
     DESCRIPTION OF EMBODIMENTS 
       [0049]    Hereinafter, preferred embodiments to practice the present disclosure (hereinafter referred to as embodiments) will be described with reference to the appended drawings. Note that the description will be given in the order shown below. 
         [0050]    1. First embodiment (example of setting detection area in accordance with optical axis adjustment and parallax adjustment) 
         [0051]    2. Second embodiment (example of setting detection area in accordance with optical axis adjustment only) 
         [0052]    3. Other embodiments 
       1. First Embodiment 
       [0053]    1-1. Configuration of Compound-Eye Imaging Device 
         [0054]    A compound-eye imaging device  1  shown in  FIG. 1  generates image signals of two systems that form a stereoscopic image, by performing compound-eye imaging in which a specific imaging target is captured while controlling two imaging units  3 A and  3 B using a control unit  2 . 
         [0055]    The control unit  2  has a system controller  5  that comprehensively controls the whole, an operation portion  6  that receives operations from a user, and a display portion  7  that displays various pieces of information. 
         [0056]    As shown in  FIG. 2 , the system controller  5  is formed centrally of a CPU (Central 
         [0057]    Processing Unit)  11 , to which a ROM (Read Only Memory)  12 , a RAM (Random Access Memory)  13  and a non-volatile memory  14  are connected via a bus  15 . 
         [0058]    The CPU  11  reads out various programs from the ROM  12  and the non-volatile memory  14 , such as a specific basic program and a multiple image adjustment control program, and executes these programs while using the RAM  13  as a working memory and so on. 
         [0059]    It should be noted that the non-volatile memory  14  stores values required for image adjustment processing, such as focus control and exposure control for the imaging units  3 A and  3 B, respectively, and various values used in control of the imaging units  3 A and  3 B. 
         [0060]    The CPU  11  transmits various control signals etc. to each portion of the imaging units  3 A and  3 B via a communication interface (I/F)  16 , and also acquires various pieces of information from each of the portions of the imaging units  3 A and  3 B. 
         [0061]    The operation portion  6  ( FIG. 1 ) is formed of various operation buttons or a touch panel, for example, and generates an operation signal in accordance with content of a user operation and supplies the generated operation signal to the system controller  5 . The operation portion  6  is provided with, for example, an imaging button that starts or stops imaging processing, cursor buttons that operate various menus, a zoom lever that adjusts a ratio of an image, and a parallax amount adjustment dial that adjusts an amount of left and right parallax in order to change a sense of depth during stereoscopic viewing. 
         [0062]    The display portion  7  is formed of a liquid crystal panel, for example, and displays a display screen based on a display signal supplied from the system controller  5 , thereby presenting to the user images captured by the imaging units  3 A and  3 B and various pieces of information, such as various setting contents etc. 
         [0063]    Based on control of the control unit  2 , the imaging unit  3 A captures an imaging target (not shown in the drawings) from a different viewpoint than the imaging unit  3 B, and generates an image signal of one system. Note that the imaging unit  3 A generates the image signal corresponding to the right eye. 
         [0064]    Using an optical adjustment portion  20 A, the imaging unit  3 A optically adjusts imaging light obtained from the imaging target, and performs image capture using an imaging element  24 A. Specifically, the imaging unit  3 A uses a zoom lens  21 A to scale up the imaging light at a specific zoom ratio, reduces the amount of the imaging light using an aperture  22 A and adjusts a focus using a focus lens  23 A. 
         [0065]    At that time, the system controller  5  of the control unit  2  respectively controls, via a lens driver  31 A, a zoom ratio of the zoom lens  21 A, an aperture amount of the aperture  22 A and a focus position of the focus lens  23 A. Further, the system controller  5  controls a shutter speed of the imaging element  24 A, via a timing generator  32 A. 
         [0066]    The imaging element  24 A is, for example, a CMOS (Complementary Metal Oxide Semiconductor). Each pixel is provided with a color filter of a complementary color system or a primary color system, and the imaging element  24 A generates an imaging signal in which each pixel is expressed by a color signal of a complementary color or a primary color. In actuality, the imaging element  24 A generates an analog image signal V 1 A by performing photo-electric conversion on incident imaging light at an interval based on control of the timing generator  32 A. The analog image signal V 1 A is supplied to an analog signal processing portion  25 A. 
         [0067]    After performing correlated double sampling on the image signal V 1 A, the analog signal processing portion  25 A generates an image signal V 2 A by adjusting gain of the image signal V 1 A based on control of the system controller  5 , and supplies the image signal V 2 A to an A/D (Analog/Digital) converter  26 A. 
         [0068]    The A/D converter  26 A generates a digital image signal V 3 A by performing analog to digital conversion on the analog image signal V 2 A, and supplies the digital image signal V 3 A to a digital signal processing portion  27 A. 
         [0069]    The digital signal processing portion  27 A is formed, for example, of a digital signal processor, and performs a variety of image adjustment processing on the image signal V 3 A based on the control of the system controller  5 . The image adjustment processing that is performed here is, for example, white balance correction processing or gamma correction processing etc., and includes a variety of processing on the image signal after image capture. 
         [0070]    In addition, the digital signal processing portion  27 A extracts, from the image signal V 3 A, an image that is an area to be extracted as a final image (hereinafter referred to as an extraction area), generates this as an image signal V 4 A, and supplies the image signal V 4 A to a memory  8 . 
         [0071]    After temporarily storing the image signal V 4 A, the memory  8  supplies the image signal V 4 A to a storage portion  9 . The storage portion  9  is, for example, an optical disk drive or a magnetic disk drive, or a flash memory or the like, and stores the image signals V 4 A that are sequentially supplied. Further, in accordance with a request from the system controller  5 , the storage portion  9  reads out the stored image signal V 4 A and supplies it to the memory  8 . 
         [0072]    In addition, based on pixel values inside a specified area of the image expressed by the image signal V 3 A, the digital signal processing portion  27 A generates a plurality of types of detection values that are used when adjusting the image signal V 3 A, and supplies the detection values to the system controller  5  (this will be explained in more detail later). 
         [0073]    Based on these detection values, the system controller  5  performs various controls, such as zoom control, aperture control, focus control and shutter speed control etc., via the lens driver  31 A and the timing generator  32 A. 
         [0074]    In this way, based on the control of the control unit  2 , the imaging unit  3 A captures the imaging target in the same manner as a general video camera or the like and generates the image signal V 4 A. Hereinafter, processing that generates the image signal V 4 A of the imaging target by the imaging unit  3 A based on the control of the control unit  2  will also be referred to as single-eye imaging processing. 
         [0075]    Meanwhile, the imaging unit  3 B is formed in a similar manner to the imaging unit  3 A, and captures the imaging target, based on the control of the control unit  2 , from a slightly different position and direction than that of the imaging unit  3 A. Thus, the imaging unit  3 B generates an image signal V 4 B that corresponds to the image signal V 4 A. Note that the imaging unit  3 B generates an image signal corresponding to the left eye. 
         [0076]    At this time, by linking various controls of the imaging units  3 A and  3 B, such as the zoom control, the aperture control, the focus control and the shutter speed control, the control unit  2  performs compound-eye imaging control that comprehensively controls various adjustment values relating to the image signals V 4 A and V 4 B, such as focus position and exposure etc. 
         [0077]    Thus, the image signals V 4 A and V 4 B generated by the imaging units  3 A and  3 B respectively form an image for the right eye and an image for the left eye that express a stereoscopic image. 
         [0078]    Using the control unit  2  in this way, the compound-eye imaging device  1  controls the imaging units  3 A and  3 B in a linked manner, and performs compound-eye imaging processing, thus generating, respectively, the image signals V 4 A and V 4 B that express the stereoscopic image. 
         [0079]    It should be noted that, in a manufacturing adjustment process etc. of the imaging units  3 A and  3 B, although optical axes of the optical adjustment portion  20 A and an optical adjustment portion  20 B are respectively adjusted such that imaging regions of the imaging element  24 A and an imaging element  24 B are mutually aligned, there are cases in which an adjustment error occurs. 
         [0080]    When there is such an adjustment error, due to misalignment between the optical adjustment portions  20 A and  20 B, displacement between the respective imaging regions occurs in the imaging units  3 A and  3 B. When the zoom ratio of the zoom lens  21 A and a zoom lens  21 B is raised, namely when a high zoom ratio is set using the zoom lever of the operation portion  6 , this type of displacement between the imaging regions appears even more clearly. 
         [0081]    However, the displacement of the imaging regions can be substantially resolved by processing (hereinafter referred to as optical axis correction processing), in which extraction areas from the image signal V 3 A and an image signal V 3 B are each moved and the imaging regions of the final image signals V 4 A and V 4 B are roughly aligned with each other. 
         [0082]    Here, in the manufacturing adjustment process of the compound-eye imaging device  1 , a relationship between a set zoom ratio and an appropriate amount of movement of the extraction area (hereinafter referred to as an optical axis correction amount) is measured, and an optical axis correction table is generated that represents the relationship between the zoom ratio and the optical axis correction amount Then, the optical axis correction table is stored in the non-volatile memory  14  ( FIG. 2 ) of the system controller  5 . 
         [0083]    1-2. Image Adjustment Processing 
         [0084]    Next, adjustment processing of images expressed by the image signals V 3 A and V 3 B, which is performed by the system controller  5  of the control unit  2  and by the digital signal processing portion  27 A and a digital signal processing portion  27 B of the imaging units  3 A and  3 B, will be explained. 
         [0085]    By executing specific imaging processing programs, the system controller  5  executes various functions internally, as shown in  FIG. 3 , for example. Further, the digital signal processing portions  27 A and  27 B are programmed in advance, and thus they are set to realize various functions shown in  FIG. 3 . 
         [0086]    First, the system controller  5  respectively sets extraction areas of the image signals V 3 A and V 3 B, using an extraction/scaling control portion  40 . Specifically, as the optical axis correction processing, optical axis correction control portions  41 A and  41 B of the extraction/scaling control portion  40  read out the optical axis correction table from the non-volatile memory  14 , determine the optical axis correction amount according to the zoom ratio at that time, and set extraction areas TA 1  and TB 1  as first areas. 
         [0087]    Here, as shown in  FIG. 4  (A), original images MA and MB, which are whole areas of the images expressed by the image signals V 3 A and V 3 B, are schematically depicted as imaging targets JA and JB that correspond to each other. 
         [0088]    In  FIG. 4  (A), a relative position of the imaging target JA with respect to the original image MA, and a relative position of the imaging target JB with respect to the original image MB are mutually different. Meanwhile, the relative position of the imaging target JA with respect to the extraction area TA 1  and the relative position of the imaging target JB with respect to the extraction area TB 1  are both substantially central and match each other. 
         [0089]    Next, based on the extraction area set by the optical axis correction processing, a parallax amount control portion  42  of the extraction/scaling control portion  40  once more sets an extraction area, so as to adjust a sense of depth during stereoscopic viewing of the image signals V 4 A and V 4 B. Hereinafter, this type of processing is also referred to as parallax amount adjustment processing. 
         [0090]    More specifically, as shown in  FIG. 4  (B) and  FIG. 4  (C) that correspond to  FIG. 4  (A), the parallax amount control portion  42  sets, as second areas, for example, extraction areas TA 2  and TB 2 , in positions to which the extraction areas TA 1  and TB 1  have been respectively moved in the left-right direction in accordance with a parallax amount instructed by the parallax amount adjustment dial of the operation portion  6 . 
         [0091]    It should be noted that  FIG. 4  (B) shows a case in which the imaging target is positioned further to the front than the display screen and  FIG. 4  (C) shows a case in which the imaging target is positioned further to the rear than the display screen. 
         [0092]    After that, an extraction area signal generation portion  43 A of the extraction/scaling control portion  40  generates extraction area signals STA 2  and STB 2  that express the position and size etc. of the extraction areas TA 2  and TB 2 . Then, the extraction area signal generation portion  43 A supplies the extraction area signals STA 2  and STB 2  to detection area control portions  44 A and  44 B and to extraction/scaling portions  55 A and  55 B of the digital signal processing portions  27 A and  27 B, respectively. 
         [0093]    In accordance with the supplied extraction area signal STA 2 , the detection area control portion  44 A sets a rectangular detection area DA 2  that has a predetermined size ( FIG. 4  (B) and  FIG. 4  (C)), in a position that is roughly at the center of the extraction area TA 2 . 
         [0094]    The detection area DA 2  represents an area, of the extraction area TA 2  that is finally extracted, for which a degree of focusing and exposure should be optimally adjusted by focus control and exposure control. The detection area DA 2  is also called a detection frame. 
         [0095]    Further, the detection area DA 2  is set in a position corresponding to the extraction area TA 2  after the parallax amount adjustment processing. In other words, the detection area DA 2  is set in a position that is different to the detection area DA 1  which is assumed to be set corresponding to the extraction area TA 1  before the parallax amount adjustment processing. 
         [0096]    In a similar manner, the detection area control portion  44 B sets a detection area DB 2  roughly in the center of the extraction area TB 2 , in accordance with the supplied extraction area signal STB 2 . 
         [0097]    Then, the detection area control portions  44 A and  44 B ( FIG. 3 ) generate detection area signals SDA and SDB that express the position and size etc. of the detection areas DA 2  and DB 2 , and supply the detection area signals SDA and SDB to detection portions  52 A and  52 B of the digital signal processing portions  27 A and  27 B, respectively. 
         [0098]    On the other hand, the digital signal processing portion  27 A amplifies the image signal V 3 A supplied from the A/D converter  26 A ( FIG. 1 ) using an amplifier  51 A, and supplies the amplified image signal V 3 A to the detection portion  52 A and a white balance adjustment portion  53 A. 
         [0099]    The detection portion  52 A includes a sharpness detection portion  52 A 1 , a luminance detection portion  52 A 2  and a color signal detection portion  52 A 3 , and generates a plurality of various detection values, based on pixel values inside the detection area DA that is specified by the detection area signal SDA of the image signal V 3 A. 
         [0100]    More specifically, by performing arithmetic processing, such as differentiation etc., on the pixel values of the pixels included in the detection area DA 2  of the image signal V 3 A, the sharpness detection portion  52 A 1  generates a sharpness signal SSA, which expresses sharpness. The sharpness detection portion  52 A 1  supplies the sharpness signal SSA to a lens control portion  45 . 
         [0101]    Based on the sharpness signal SSA, the lens control portion  45  controls a position of the focus lens  23 A, via the lens driver  31 A, such that the sharpness of the section corresponding to the detection area DA 2  of the image signal V 3 A is highest, namely, such that that section comes into focus. 
         [0102]    The luminance detection portion  52 A 2  generates a luminance signal SBA by performing arithmetic processing, such as integration etc., with respect to luminance values of pixels included in the detection area DA 2  of the image signal V 3 A. The luminance detection portion  52 A 2  supplies the generated luminance signal SBA to an exposure control portion  46 . 
         [0103]    Based on the luminance signal SBA, the exposure control portion  46  controls the aperture  22 A, via the lens driver  31 A, such that an exposure value of the section corresponding to the detection area DA 2  of the image signal V 3 A is an optimal value. In addition, the exposure control portion  46  controls, via the timing generator  32 A, the shutter speed of the imaging element  24 A, and further controls an amplification gain of an amplifier  51 A. 
         [0104]    A color signal detection portion  52 A 3  generates a color signal SCA by performing specific arithmetic processing on pixel values of pixels included in the detection area DA 2  of the image signal V 3 A, and supplies the color signal SCA to a white balance control portion  47 . 
         [0105]    Based on the color signal SCA, the white balance control portion  47  generates a white balance adjustment signal SWA, and supplies the white balance adjustment signal SWA to the white balance adjustment portion  53 A. Based on the white balance adjustment signal SWA, the white balance adjustment portion  53 A adjusts the white balance of the image signal V 3 A, and supplies the adjusted image signal V 3 A to a gamma correction portion  54 A. 
         [0106]    The gamma correction portion  54 A performs specific gamma correction processing on the image signal V 3 A, and supplies the processed image signal V 3 A to the extraction/scaling portion  55 A. The extraction/scaling portion  55 A generates the image signal V 4 A by extracting an area indicated by the extraction area signal STA 2  of the image signal V 3 A, and supplies the image signal V 4 A to a memory  7 . 
         [0107]    Meanwhile, in correspondence to the digital signal processing portion  27 A, the digital signal processing portion  27 B generates a sharpness signal SSB, a luminance signal SBB and a color signal SCB, respectively, by a sharpness detection portion  52 B 1 , a luminance detection portion  52 B 2  and a color signal detection portion  52 B 3  of the detection portion  52 B. 
         [0108]    Based on the sharpness signal SSB, the lens control portion  45  controls a position of a focus lens  23 B, via a lens driver  31 B, such that the sharpness of the section corresponding to the detection area DB 2  of the image signal V 3 B is highest, namely, such that that section comes into focus. 
         [0109]    At that time, the lens control portion  45  corrects a control signal that is supplied to the lens driver  31 B for the left side, based on the sharpness signal SSA for the right side. The lens control portion  45  also corrects a control signal that is supplied to the lens driver  31 A for the right side, based on the sharpness signal SSB for the left side. 
         [0110]    Based on the luminance signal SBB, the exposure control portion  46  controls an aperture amount of an aperture  22 B, via the lens driver  31 B, such that an exposure value of the section corresponding to the detection area DB 2  of the image signal V 3 B is an optimal value. In addition, the exposure control portion  46  controls, via a timing generator  32 B, the shutter speed of the imaging element  24 B, and further controls an amplification gain of an amplifier  51 B. 
         [0111]    At that time, similarly to the lens control portion  45 , the exposure control portion  46  corrects control signals that are respectively supplied to the lens driver  31 B, the timing generator  32 B and to the amplifier  51 B for the left side, based on the luminance signal SBA for the right side. In addition, the exposure control portion  46  also corrects control signals that are respectively supplied to the lens driver  31 A, the timing generator  32 A and the amplifier  51  A for the right side, based on the luminance signal SBB for the left side. 
         [0112]    Based on the color signal SCB, the white balance control portion  47  generates a white balance adjustment signal SWB, and supplies the white balance adjustment signal SWB to a white balance adjustment portion  53 B. 
         [0113]    At that time, the white balance control portion  47  corrects the white balance adjustment signal SWB that is supplied to the white balance adjustment portion  53 B for the left side, based on the color signal SCA for the right side. In addition, the white balance control portion  47  also corrects the white balance adjustment signal SWA that is supplied to the white balance adjustment portion  53 A for the right side, based on the color signal SCB for the left side. 
         [0114]    The digital signal processing portion  27 B amplifies the image signal V 3 B using the amplifier  51 B, adjusts the white balance using the white balance adjustment portion  53 B, and applies gamma correction processing by the gamma correction portion  54 B and then supplies the image signal V 3 B to the extraction/scaling portion  55 B. The extraction/scaling portion  55 B generates the image signal V 4 B by extracting an area indicated by the extraction area signal STB 2  of the image signal V 3 B, and supplies the image signal V 4 B to the memory  7 . 
         [0115]    In other words, with respect to each of the image signals V 3 A and V 3 B obtained by image capture, the imaging units  3 A and  3 B ( FIG. 1 ) perform focus control, exposure control and white balance control, while placing importance on detection values of each of the detection areas DA 2  and DB 2  and also taking into consideration the detection values of the image signal on the other side. 
         [0116]    In this way, in the compound-eye imaging device  1 , the extraction areas TA 2  and TB 2  are set by the optical axis correction processing and by the parallax amount adjustment processing and, at the same time, the detection areas DA 2  and DB 2  are set. Then, various detection values, such as sharpness etc. are generated from the pixel values etc. within the detection areas DA 2  and DB 2 . Then, based on the various generated detection values, the compound-eye imaging device  1  performs processing that adjusts the image, such as focus control and exposure control etc. (hereinafter referred to collectively as imaging adjustment processing), and thus the compound-eye imaging device  1  generates the image signals V 4 A and V 4 B that express the stereoscopic image. 
         [0117]    1-3. Relationship Between Imaging Target and Position of Detection Areas 
         [0118]    Here, a relationship will be explained between a stereoscopic effect that is obtained when a viewer stereoscopically views an image of the image signals V 4 A and V 4 B using a television device or the like, and a position of the detection areas. 
         [0119]    Generally, when stereoscopically viewing images using a television device, the image signals V 4 A and V 4 B are alternately displayed on the television device one frame or one field at a time. The viewer puts on glasses, and left and right lenses of the glasses are alternately blocked in synchronization with the images, by liquid crystal shutters or the like. 
         [0120]    By doing this, within a front display screen, the viewer sees only the image based on the image signal V 4 A with his/her right eye and, at the same time, sees only the image based on the image signal V 4 B with his/her left eye. 
         [0121]      FIG. 5  (A) to  FIG. 5  (C) schematically show this state, and images displayed on display screens are shown in an upper section and positional relationships between the viewer&#39;s eyes, the display screens and obtained images are shown in a lower section respectively along with detection areas. The extraction areas TA 1  and TB 1 , or the extraction areas TA 2  and TB 2  are displayed on the whole of the display screen. 
         [0122]      FIG. 5  (A) corresponds to  FIG. 4  (A) and shows positional relationships between viewpoints VA and VB of the viewer, the extraction areas TA 1  and TB 1  when only the optical axis correction processing has been performed, the imaging targets JA and JB, and the detection areas DA 1  and DB 1 . In this case, the detection areas DA 1  and DB 1  are aligned with each other on the display screen. 
         [0123]      FIG. 5  (B) corresponds to  FIG. 4  (B) and shows a case in which, in addition to the optical axis correction processing, the parallax amount adjustment processing has been performed such that the image appears to be positioned to the front. In this case, the imaging targets JA and JB are displaced to the left and the right on the display screen, and thus the viewer subconsciously tries to overlap the imaging targets JA and JB in his/her brain, and a stereoscopic effect can thus be obtained in which the image is to the front. 
         [0124]    Here, as the detection areas DA 2  and DB 2  are matched to the imaging targets JA and JB, respectively, the image signals V 4 A and V 4 B are adjusted such that the focus and the exposure etc. are matched with the imaging targets in each of the left and right images. For that reason, the imaging targets appear vividly to the viewer and the viewer can enjoy images that have a sense of depth. 
         [0125]      FIG. 5  (C) corresponds to  FIG. 4  (C) and shows a case in which, in addition to the optical axis correction processing, the parallax amount adjustment processing is performed such that the image appears to be positioned to the rear. In this case, the imaging targets are displaced to the left and to the right in opposite directions to those of  FIG. 5  (B) and therefore, a stereoscopic effect can be imparted to the viewer in which the image is to the rear. In this case, the imaging targets appear vividly to the viewer and the viewer can perceive images that have a sense of depth. 
         [0126]    1-4. Detection Area Setting Processing Procedure 
         [0127]    Next, detection area setting processing procedures RT 1  and RT 2 , which are used in the compound-eye imaging device  1  when respectively setting the right side and left side detection areas DA 2  and DB 2 , will be explained with reference to flowcharts shown in  FIG. 6  and  FIG. 7 . It should be noted that either the right side detection area setting processing procedure RT 1  or the left side detection area setting processing procedure RT 2  may be processed first, or parallel processing may be performed. 
         [0128]    Furthermore, for explanatory purposes, coordinates within the screen take the top left of the screen as an origin point, an x axis is set is a direction from the left toward the right and a y axis is set in a direction from the top toward the bottom. In addition, the extraction areas TA and the detection areas DA are expressed by coordinates of their top left and bottom right vertices. 
         [0129]    When the imaging processing is started, the CPU  11  of the system controller  5  starts the right side detection area setting processing procedure RT 1  ( FIG. 6 ) and moves to step SP 1 . 
         [0130]    At step SP 1 , the CPU  11  reads out the optical axis correction table from the non-volatile memory  14  using the optical axis correction control portion  41 A, and determines the right side optical axis correction amount in accordance with the zoom ratio at this time. Then, the CPU  11  determines coordinates (TA 1 Lx, TA 1 Ly) expressing the upper left vertex based on the optical axis correction amount, and moves to the next step SP 2 . 
         [0131]    At step SP 2 , the CPU  11  calculates coordinates (TA 1 Rx, TA 1 Ry) expressing the lower right vertex in accordance with a specific arithmetic expression that is based on the coordinates (TA 1 Lx, TA 1 Ly) expressing the upper left vertex of the extraction area TA 1  and on the zoom ratio set by the zoom lever of the operation portion  6 , and then moves to the next step SP 3 . 
         [0132]    At step SP 3 , the CPU  11  sets the extraction area TA 1  with the coordinates (TA 1 Lx, TA 1 Ly) and the coordinates (TA 1 Rx, TA 1 Ry) as the upper left vertex and the lower right vertex, respectively, and moves to the next step SP 4 . 
         [0133]    At step SP 4 , using the parallax amount control portion  42 , the CPU  11  calculates, using the following Formula (1), coordinates (TA 2 Lx, TA 2 Ly) expressing the upper left vertex of the extraction area TA 2 , based on the upper left vertex (TA 1 Lx, TA 1 Ly) of the set extraction area TA 1  and on an adjustment amount S that is set in accordance with the parallax amount, and then moves to the next step SP 5 . 
         [0000]        TA 2 Lx=TA 1 Lx+S    
         [0000]        TA 2 Ly=TA 1 Ly    (1)
 
         [0134]    At step SP 5 , the CPU  11  calculates coordinates (TA 2 Rx, TA 2 Ry) expressing the lower right vertex in accordance with a specific arithmetic expression that is based on the coordinates (TA 2 Lx, TA 2 Ly) expressing the upper left vertex of the extraction area TA 2  and on the zoom ratio set using the zoom lever of the operation portion  6 , and then moves to the next step SP 6 . 
         [0135]    At step SP 6 , the CPU  11  sets the extraction area TA 2  with the coordinates (TA 2 Lx, TA 2 Ly) and the coordinates (TA 2 Rx, TA 2 Ry) as the upper left vertex and the lower right vertex, respectively, and moves to the next step SP 7 . 
         [0136]    At step SP 7 , using the detection area control portion  44 A, the CPU  11  calculates, using the following Formula (2), coordinates (DA 2 Lx, DA 2 Ly) expressing the upper left vertex of the detection area DA 2 , based on the upper left vertex (TA 2 Lx, TA 2 Ly) of the extraction area TA 2  and on a constant (Cx, Cy), and then moves to the next step SP 8 . Here, the constant (Cx, Cy) is a value that is established based on a difference between the sizes of the extraction area TA 2  and the detection area DA 2 . 
         [0000]        DA 2 Lx=TA 2 Lx+Cx    
         [0000]        DA 2 Ly=TA 2 Ly+Cy    (2)
 
         [0137]    At step SP 8 , the CPU  11  calculates coordinates (DA 2 Rx, DA 2 Ry) expressing the lower right vertex in accordance with a specific arithmetic expression that is based on the coordinates (DA 2 Lx, DA 2 Ly) expressing the upper left vertex of the detection area DA 2 , and then moves to the next step SP 9 . 
         [0138]    At step SP 9 , the CPU  11  sets the detection area DA 2  with the coordinates (DA 2 Lx, DA 2 Ly) and the coordinates (DA 2 Rx, DA 2 Ry) as the upper left vertex and the lower right vertex, respectively, and moves to the next step SP 10 . 
         [0139]    At step SP 10 , the CPU  11  generates detection area information SDA that represents the set detection area DA 2 , and supplies the detection area information SDA to the detection portion  52 A. The CPU  11  then moves to the next step SP 11 , and ends the right side detection area setting processing procedure RT 1 . 
         [0140]    Further, when the imaging processing is started, the CPU  11  of the system controller  5  starts the left side detection area setting processing procedure RT 2  ( FIG. 7 ) and moves to step SP 21 . 
         [0141]    At step SP 21 , similarly to the right side, the CPU  11  reads out the optical axis correction table from the non-volatile memory  14  using the optical axis correction control portion  41 B, and determines the left side optical axis correction amount in accordance with the zoom ratio at this time. Then, the CPU  11  determines coordinates (TB 1 Lx, TB 1 Ly) expressing the upper left vertex based on the optical axis correction amount, and moves to the next step SP 22 . 
         [0142]    At step SP 22  and step SP 23 , similarly to the case of the right side, the CPU  11  sets the extraction area TB  1  after calculating coordinates (TB  1 Rx, TB 1 Ry) expressing the lower right vertex, and then moves to the next step SP 24 . 
         [0143]    At step SP 24 , using the parallax amount control portion  42 , the CPU  11  calculates, using the following Formula (3) in which some of the numerals are reversed from those for the right side, coordinates (TB 2 Lx, TB 2 Ly) expressing the upper left vertex of the extraction area TB 2 , based on the upper left vertex (TB 1 Lx, TB 1 Ly) of the set extraction area TB 1  and on the adjustment amount S, and then moves to the next step SP 25 . 
         [0000]        TB 2 Lx=TB 1 Lx−S    
         [0000]        TB 2 Ly=TB 1 Ly    (3)
 
         [0144]    At step SP 25  and step SP 26 , similarly to the case of the right side, the CPU  11  sets the extraction area TB 2  after calculating coordinates (TB 2 Rx, TB 2 Ry) expressing the lower right vertex, and then moves to the next step SP 27 . 
         [0145]    At step SP 27 , similarly to the case of the right side, using the detection area control portion  44 B, the CPU  11  calculates, using the following Formula (4), coordinates (DB 2 Lx, DB 2 Ly) expressing the upper left vertex of the detection area DB 2 , based on the upper left vertex (TB 2 Lx, TB 2 Ly) of the extraction area TB 2  and on the constant (Cx, Cy), and then moves to the next step SP 28 . 
         [0000]        DB 2 Lx=TB 2 Lx+Cx    
         [0000]        DB 2 Ly=TB 2 Ly+Cy    (4)
 
         [0146]    At step SP 28  and step SP 29 , similarly to the case of the right side, the CPU  11  sets the extraction area DB 2  after calculating coordinates (DB 2 Rx, DB 2 Ry) expressing the lower right vertex, and then moves to the next step SP 30 . 
         [0147]    At step S 30 , the CPU  11  generates detection area information SDB that represents the set detection area DB 2 , and supplies the detection area information SDB to the detection portion  52 B. The CPU  11  then moves to the next step SP 31 , and ends the left side detection area setting processing procedure RT 2 . 
         [0148]    1-5. Operations and Effects 
         [0149]    With the above-described configuration, the compound-eye imaging device  1  according to the first embodiment respectively sets the extraction areas TA 1  and TB 1  in the image signals V 3 A and V 3 B using the optical axis correction control portions  41 A and  41 B and by the optical axis correction processing in accordance with the zoom ratio at this time. 
         [0150]    The parallax amount control portion  42  respectively sets the extraction areas TA 2  and TB 2  such that the extraction areas TA 1  and TB 1  are displaced in the left-right direction by the parallax amount adjustment processing in accordance with the stereoscopic effect that is wished to be imparted to the viewer. 
         [0151]    The detection area control portions  44 A and  44 B respectively set the detection areas DA 2  and DB 2  such that the detection areas DA 2  and DB 2  are positioned substantially in the center of the extraction areas TA 2  and TB 2 . 
         [0152]    Then, after the detection portions  52 A and  52 B have generated the various detection values, such as sharpness etc., based on the pixel values inside the detection areas DA 2  and DB 2 , the digital signal processing portions  27 A and  27 B perform the image adjustment processing, such as focus control, exposure control and the like. 
         [0153]    As a result, the compound-eye imaging device  1  can position the imaging targets JA and JB in mutually corresponding positions in the image signals V 4 A and V 4 B, and can also optimize the focus and exposure for each of the imaging targets JA and JB. Thus, the stereoscopic image of the imaging targets can be vividly captured. 
         [0154]    With the image signals V 4 A and V 4 B generated in this manner, it is possible to show a viewer who has seen the image of the image signals V 4 A and V 4 B via a specific display device, the vivid imaging targets for the right eye and the left eye, respectively. As a result, it is possible to impart an appropriate sense of depth with respect to the imaging targets. 
         [0155]    In particular, the compound-eye imaging device  1  sets the detection areas DA 2  and DB 2  for the image signals V 3 A and V 3 B, respectively, and performs the image adjustment processing for each of the images while placing importance on each of the detection values generated from the pixel values inside the detection areas DA 2  and DB 2 , respectively, while also taking other detection values into consideration. 
         [0156]    As a result, the compound-eye imaging device  1  can capture the respective imaging targets extremely vividly, by respectively performing the image adjustment processing with respect to each of the left and right image signals, based on the detection values obtained from the pixel values within the detection areas of each of the image signals. 
         [0157]    In addition, the compound-eye imaging device  1  can enhance the mutual correlativity of each of the left and right image signals by correcting each of the adjustment values etc. based on the detection values obtained from the image signal on the other side and can thus reduce a sense of discomfort arising from differences between the left and right images. 
         [0158]    With the above-described configuration, the compound-eye imaging device  1  respectively sets the extraction areas TA 1  and TB 1  in the image signals V 3 A and V 3 B by the optical axis correction processing in accordance with the zoom ratio at this time, and further respectively sets the extraction areas TA 2  and TB 2  by the parallax amount adjustment processing in accordance with the stereoscopic effect that is wished to be imparted to the viewer. Then, the compound-eye imaging device  1  respectively sets the detection areas DA 2  and DB 2  in positions that are substantially in the center of the extraction areas TA 2  and TB 2 , and, after the various detection values have been generated based on the pixel values within the detection areas DA 2  and DB 2 , the compound-eye imaging device  1  performs the image adjustment processing, such as focus control, exposure control and the like. As a result, the compound-eye imaging device  1  can position the imaging targets JA and JB in mutually corresponding positions in the image signals V 4 A and V 4 B, and can respectively optimally control the focus and exposure in alignment with the imaging targets JA and JB. The compound-eye imaging device  1  can thus adjust for the vivid stereoscopic image. 
       2. Second Embodiment 
       [0159]    2-1. Configuration of Compound-Eye Imaging Device 
         [0160]    In comparison to the compound-eye imaging device  1  according to the first embodiment, a compound-eye imaging device  71  ( FIG. 1 ) according to a second embodiment differs in that it has a system controller  75  in place of the system controller  5 , while having a similar configuration in all other respects. 
         [0161]    In comparison to the system controller  5 , the system controller  75  ( FIG. 3 ) differs in that it has an extraction/scaling control portion  80  and detection area control portions  84 A and  84 B in place of the extraction/scaling control portion  40  and the detection area control portions  44 A and  44 B. 
         [0162]    The extraction/scaling control portion  80  has extraction area signal generation portions  83 A and  83 B in place of the extraction area signal generation portions  43 A and  43 B. 
         [0163]    2-2. Detection Area Setting 
         [0164]    As shown in  FIG. 8  (A), which corresponds to  FIG. 4  (A), similarly to the case of the extraction/scaling control portion  40 , the optical axis correction control portions  41 A and  41 B of the extraction/scaling control portion  80  read out the optical axis correction table from the non-volatile memory  14 , determine the optical axis correction amount according to the zoom ratio at that time, and set the extraction areas TA 1  and TB 1 . 
         [0165]    Further, as shown in  FIG. 8  (B) and  FIG. 8  (C) which correspond to  FIG. 4  (B) and  FIG. 4  (C), the parallax amount control portion  42  sets the final extraction areas TA 2  and TB 2 , in positions to which the extraction areas TA 1  and TB 1  have been respectively moved in the left-right direction. 
         [0166]    The extraction area signal generation portions  83 A and  83 B supply the extraction area signals STA 2  and STB 2 , which express the position and size etc. of the extraction areas TA 2  and TB 2 , to the extraction/scaling portions  55 A and  55 B of the digital signal processing portions  27 A and  27 B, respectively. 
         [0167]    In addition, in contrast to the extraction area signal generation portions  43 A and  43 B, the extraction area signal generation portions  83 A and  83 B generate extraction area signals STA 1  and STB 1  that express the position and size of the extraction areas TA 1  and TB  1  before being re-set, and supply the extraction area signals STA 1  and STB 1  to the detection area control portions  84 A and  84 B. 
         [0168]    In accordance with the supplied extraction area signal STA 1 , the detection area control portions  84 A and  84 B set the detection areas DA 1  and DB 1  ( FIG. 8  (B) and  FIG. 8  (C)) in positions that are substantially in the center of the extraction areas TA 1  and TB 1  before being re-set. 
         [0169]    Then, the detection area control portions  84 A and  84 B ( FIG. 3 ) generate the detection area signals SDA and SDB, which express the position and size etc. of the detection areas DA 1  and DB 1 , and supply the detection area signals SDA and SDB to the detection portions  52 A and  52 B of the digital signal processing portions  27 A and  27 B, respectively. 
         [0170]    Based on pixel values of pixels included within the detection areas DA 1  and DB 1  of the image signals V 3 A and V 3 B, the detection portions  52 A and  52 B generate various signals, such as a sharpness signal that expresses sharpness etc., and supply the various signals to the lens control portion  45 , the exposure control portion  46  and the white balance control portion  47 , respectively. 
         [0171]    In response to this, based on the various signals generated from the pixel values of each of the detection areas DA 1  and DB 1 , the lens control portion  45 , the exposure control portion  46  and the white balance control portion  47  perform focus control, exposure control and white balance control. 
         [0172]    In this way, the compound-eye imaging device  71  sets the detection areas DA 1  and DB 1  based on the extraction areas TA 1  and TB 1  that are set by the optical axis correction processing, namely, based on the extraction areas TA 1  and TB 1  before being re-set by the parallax amount adjustment processing, and generates the various detection values, such as sharpness etc., from the pixel values etc. within the detection areas DA 1  and DB 1 . Then, by performing the image adjustment processing based on the various generated detection values, the compound-eye imaging device  71  generates the image signals V 4 A and V 4 B that express the stereoscopic image. 
         [0173]    2-3. Relationship Between Imaging Target and Position of Detection Areas 
         [0174]    Here, a relationship will be explained between a stereoscopic effect that is obtained when a viewer stereoscopically views an image of the image signals V 4 A and V 4 B using a television device or the like, and a position of the detection areas. 
         [0175]    Similarly to  FIG. 5  (A) to  FIG. 5  (C),  FIG. 9  (A) to  FIG. 9  (C) schematically show a state in which the viewer sees only the image based on the image signal V 4 A with his/her right eye and, at the same time, sees only the image based on the image signal V 4 B with his/her left eye. 
         [0176]      FIG. 9  (A) corresponds to  FIG. 8  (A) and shows positional relationships between viewpoints VA and VB of the viewer, the extraction areas TA 1  and TB 1  when only the optical axis correction processing has been performed, the imaging targets JA and JB, and the detection areas DA 1  and DB 1 . In this case, the detection areas DA 1  and DB 1  are aligned with each other on the display screen, similarly to  FIG. 5  (A). 
         [0177]      FIG. 9  (B) corresponds to  FIG. 8  (B) and shows a case in which, in addition to the optical axis correction processing, the parallax amount adjustment processing has been performed such that the image appears to be positioned to the front, similarly to  FIG. 5  (B). In this case, the imaging targets JA and JB are displaced to the left and the right on the display screen, and thus the viewer subconsciously tries to overlap the imaging targets JA and JB in his/her brain, and a stereoscopic effect can thus be obtained in which the image is to the front. 
         [0178]    Here, in  FIG. 9  (B), the detection areas DA 1  and DB 1  are aligned at a position in which the image appears to the front. This is because the detection areas DA 1  and DB 1  are set in the center of the extraction areas TA 1  and TB 1  after the optical axis correction processing. In other words, because the detection areas DA 1  and DB 1  are set to be mutually substantially in the center with respect to the imaging targets JA and JB, when the imaging targets JA and JB are aligned, the detection areas DA 1  and DB 1  are also aligned. 
         [0179]    Thus, the alignment of the imaging targets JA and JB at the same time as the alignment of the detection areas DA 1  and DB 1  at a position in which the image appears to the front means that areas of the imaging targets JA and JB that are used as a reference for focus control and exposure control are also mutually aligned. 
         [0180]    Specifically, with the image signals V 4 A and V 4 B generated according to the second embodiment, optimal image adjustment processing is performed on each of the imaging targets JA and JB, and thus it is possible to cause the viewer who is stereoscopically viewing those images to stereoscopically view the image of the extremely vivid imaging targets. 
         [0181]      FIG. 9  (C) corresponds to  FIG. 8  (C), and shows a case in which, in addition to the optical axis correction processing, the parallax amount adjustment processing is performed such that the image appears to be positioned to the rear, similarly to  FIG. 5  (C). In this case, the imaging targets are displaced to the left and to the right in opposite directions to those of  FIG. 9  (B) and a stereoscopic effect can be imparted to the viewer in which the image is to the rear. In this case, the imaging targets appear extremely vividly to the viewer and the viewer can perceive the image that has a sense of depth. 
         [0182]    2-4. Detection Area Setting Processing Procedure 
         [0183]    Next, detection area setting processing procedures RT 3  and RT 4 , which are used in the compound-eye imaging device  71  when respectively setting the right side and left side detection areas DA 1  and DB 1 , will be explained with reference to flowcharts shown in  FIG. 10  and  FIG. 11 . It should be noted that either the right side detection area setting processing procedure RT 3  or the left side detection area setting processing procedure RT 4  may be processed first, or parallel processing may be performed. 
         [0184]    When the imaging processing is started, the CPU  11  of the system controller  75  starts the right side detection area setting processing procedure RT 3  ( FIG. 10 ) and moves to step SP 41 . Note that processing at step SP 41  to step SP 46  is the same as the processing at step SP 1  to step SP 6  and an explanation is therefore omitted here. 
         [0185]    At step SP 47  to step SP 50 , the CPU  11  performs processing that replaces the detection area DA 2  of step SP 7  to step SP 10  with the detection area DA 1 . 
         [0186]    Specifically, at step SP 47 , using the detection area control portion  84 A, the CPU  11  calculates, using the following Formula (5), coordinates (DA 1 Lx, DA 1 Ly) expressing the upper left vertex of the detection area DA 1 , based on the upper left vertex (TA 1 Lx, TA 1 Ly) of the set extraction area TA 1  and on the constant (Cx, Cy), and then moves to the next step SP 48 . 
         [0000]        DA 1 Lx=TA 1 Lx+Cx    
         [0000]        DA 1 Ly=TA 1 Ly+Cy    (5)
 
         [0187]    At step SP 48 , the CPU  11  calculates coordinates (DA 1 Rx, DA 1 Ry) expressing the lower right vertex in accordance with a specific arithmetic expression that is based on the coordinates (DA 1 Lx, DA 1 Ly) expressing the upper left vertex of the detection area DA 1 , and then moves to the next step SP 49 . 
         [0188]    At step SP 49 , the CPU  11  sets the detection area DA 1  with the coordinates (DA 1 Lx, DA 1 Ly) and the coordinates (DA 1 Rx, DA 1 Ry) as the upper left vertex and the lower right vertex, respectively, and moves to the next step SP 50 . 
         [0189]    At step SP 50 , the CPU  11  generates detection area information SDA that represents the set detection area DA 1 , and supplies the detection area information SDA to the detection portion  52 A. The CPU  11  then moves to the next step SP 51 , and ends the right side detection area setting processing procedure RT 3 . 
         [0190]    Further, when the imaging processing is started, the CPU  11  of the system controller  75  starts the left side detection area setting processing procedure RT 4  ( FIG. 11 ) and moves to step SP 61 . Note that processing at step SP 61  to step SP 66  is the same as the processing at step SP 21  to step SP 26  and an explanation is therefore omitted here. 
         [0191]    At step SP 67  to step SP 70 , the CPU  11  performs processing that replaces the detection area DB 2  of step SP 27  to step SP 30  with the detection area DB  1 . In other words, the CPU  11  performs processing that replaces the detection area DA 1  of step SP 47  to step SP 50  with the detection area DB 1 . 
         [0192]    Specifically, at step SP 67 , using the detection area control portion  84 B, the CPU  11  calculates, using the following Formula (6), coordinates (DB 1 Lx, DB 1 Ly) expressing the upper left vertex of the detection area DB 1 , based on the upper left vertex (TB 1 Lx, TB 1 Ly) of the extraction area TB 1  and on the constant (Cx, Cy), and then moves to the next step SP 68 . 
         [0000]        DB 1 Lx=TB 1 Lx+Cx    
         [0000]        DB 1 Ly=TB 1 Ly+Cy    (6)
 
         [0193]    At step SP 68  and step SP 69 , similarly to the case of the right side, the CPU  11  sets the detection area DB  1  after calculating coordinates (DB 1 Rx, DB 1 Ry) expressing the lower right vertex, and then moves to the next step SP 70 . 
         [0194]    At step SP 70 , the CPU  11  generates detection area information SDB that represents the set detection area DB 1 , and supplies the detection area information SDB to the detection portion  52 B. The CPU  11  then moves to the next step SP 71 , and ends the left side detection area setting processing procedure RT 4 . 
         [0195]    2-5. Operations and Effects 
         [0196]    With the above-described configuration, the compound-eye imaging device  71  according to the second embodiment respectively sets the extraction areas TA 1  and TB  1  in the image signals V 3 A and V 3 B using the optical axis correction control portions  41 A and  41 B and by the optical axis correction processing in accordance with the zoom ratio at this time. 
         [0197]    The parallax amount control portion  42  respectively sets the extraction areas TA 2  and TB 2  such that the extraction areas TA 1  and TB 1  are displaced in the left-right direction by the parallax amount adjustment processing in accordance with the stereoscopic effect that is wished to be imparted to the viewer. 
         [0198]    The detection area control portions  84 A and  84 B respectively set the detection areas DA 1  and DB 1  such that the detection areas DA 1  and DB 1  are positioned substantially in the center of the extraction areas TA 1  and TA 2  which are obtained by the optical axis correction processing only, rather than the extraction areas TA 2  and TB 2  which are obtained by the parallax amount adjustment processing. 
         [0199]    Then, after the detection portions  52 A and  52 B have generated the various detection values, such as sharpness etc., based on the pixel values inside the detection areas DA 1  and DB 1 , the digital signal processing portions  27 A and  27 B perform the image adjustment processing, such as focus control, exposure control and the like. 
         [0200]    As a result, the compound-eye imaging device  71  can position the imaging targets JA and JB in mutually corresponding positions in the image signals V 4 A and V 4 B, and can also optimize the focus and exposure for a location at which the imaging targets JA and JB are mutually aligned. Thus, the stereoscopic image of the imaging targets can be extremely vividly captured. 
         [0201]    At this time, in the compound-eye imaging device  71 , the detection areas DA 1  and DB 1  are respectively set in substantially the center of the extraction areas TA 1  and TB 1 , namely in locations that are displaced from the center of the extraction areas TA 2  and TB 2  which are the areas that are actually extracted from the images. 
         [0202]    For that reason, with the image signals V 4 A and V 4 B generated according to the second embodiment, at a stage of display on the display screen, the respective positions of the detection areas DA 1  and DB 1  are mutually displaced. However, when stereoscopic viewing takes place, the detection areas DA 1  and DB 1  can be aligned with the image of the imaging targets. 
         [0203]    In particular, even when there is a large parallax amount and there is a significant amount of separation between the imaging target JA for the right eye and the imaging target JB for the left eye, when stereoscopic viewing takes place, the detection areas DA 1  and DB 1  can be overlapped at a position of the image of the imaging targets. As a result, the viewer who is stereoscopically viewing the image signals V 4 A and V 4 B can perceive the extremely vivid image with a sufficient sense of depth. 
         [0204]    Further, in other points, the compound-eye imaging device  71  can achieve similar operational effects as the first embodiment. 
         [0205]    With the above-described configuration, the compound-eye imaging device  71  respectively sets the extraction areas TA 1  and TB 1  in the image signals V 3 A and V 3 B by the optical axis correction processing in accordance with the zoom ratio, and further respectively sets the extraction areas TA 2  and TB 2  by the parallax amount adjustment processing in accordance with the stereoscopic effect that is wished to be imparted to the viewer. Then, the compound-eye imaging device  1  respectively sets the detection areas DA 1  and DB 1  in positions that are substantially in the center of the previously set extraction areas TA 1  and TB 1 , and, after the various detection values have been generated based on the pixel values within the detection areas DA 1  and DB 1 , performs the image adjustment processing, such as focus control, exposure control and the like. As a result, the compound-eye imaging device  71  can position the imaging targets JA and JB in mutually displaced positions in the image signals V 4 A and V 4 B, and can optimally perform focus and exposure respectively for a location in which the imaging targets JA and JB are mutually aligned. The compound-eye imaging device  71  can thus capture an exceptionally vivid stereoscopic image. 
       3. Other embodiments 
       [0206]    Note that, in the above-described embodiments, cases are described in which the detection values are generated from the pixel values of the pixels included in the detection areas and imaging light is optically changed as the image adjustment processing. Specifically, processing to adjust the focus position of the image and the exposure etc. is performed. However, the present disclosure is not limited to this example and any one of these adjustment processing may be performed, or, with respect to the image expressed by the image signal after image capture, adjustment processing that matches the image quality to the imaging target based on the detection values obtained from the pixel values of the pixels within the detection areas may be performed, such as contrast, gamma characteristics and color adjustment, for example. 
         [0207]    Further, in the above-described embodiments, cases are described in which the extraction areas and the detection areas are set with respect to the image signals V 3 A and V 3 B that are captured by the imaging units  3 A and  3 B. However, the present disclosure is not limited to this example and image signals captured by another imaging device may be acquired and the extraction areas and detection areas may be set with respect to those image signals. In this case, a variety of image adjustment processing, such as white balance and contrast etc. can be performed on the image signals at a stage after the image signals are generated by an imaging element. 
         [0208]    Further, in the above-described embodiments, cases are described in which the coordinates of the detection areas are calculated by arithmetic operation from the coordinates of the set extraction areas. However, the present disclosure is not limited to this example, and the detection areas may be set by a variety of methods. For example, the extraction areas may be divided up inside into a plurality of areas in a grid formation, and one or two or more of the areas may be set as the detection areas in accordance with the set extraction areas. 
         [0209]    Further, in the above-described embodiments, cases are described in which the detection areas are set substantially in the center of the set extraction areas. However, the present disclosure is not limited to this example, and, in a case in which the imaging target is recognized to be part of a face by specific face recognition processing, for example, the detection areas may be set to be positioned on the eyes of the face, or the detection areas may be set on a chosen location with respect to the imaging target. 
         [0210]    Furthermore, in the above-described embodiments, cases are described in which the optical axis correction table is stored in advance, the optical axis correction amount is determined in accordance with the set zoom ratio and the extraction areas TA 1  and TB 1  are set. However, the present disclosure is not limited to this example, and, using a specific imaging target specification portion, for example, mutually corresponding imaging targets may be respectively specified from the images expressed by the image signals V 3 A and V 3 B, and areas taking the position of the imaging targets as a reference may be set as the extraction areas TA 1  and TB 1 , respectively. In addition, the extraction areas TA 1  and TB 1  may be set by performing image stabilization processing using a specific image stabilization processing portion, for example. In this way, the extraction areas TA 1  and TB 1  can be set using a variety of methods. 
         [0211]    Further, in the above-described embodiments, cases are described in which the image signals V 3 A and V 3 B, which express the whole of the areas captured by the imaging elements  24 A and  24 B, are generated, and the image signals V 4 A and V 4 B are generated by extracting part of each of the whole areas using the extraction/scaling portions  55 A and  55 B, in accordance with the extraction area signals STA 2  and STB 2 . However, the present disclosure is not limited to this example and by supplying the extraction area signals STA 2  and STB 2  to the imaging elements  24 A and  24 B, for example, part of the captured images may be extracted and the image signals V 3 A and V 3 B corresponding to the extraction areas TA 2  and TB 2  may be generated. 
         [0212]    Further, in the above-described embodiments, cases are described in which the control unit  2  and the imaging units  3 A and  3 B have an integrated structure as the compound-eye imaging devices  1  and  71 . However, the present disclosure is not limited to this example, and an independent control unit  2  may, for example, acquire image signals from two external imaging units and, at the same time, may supply various control signals to the external imaging units. 
         [0213]    Further, in the above-described embodiments, cases are described in which the image signals V 4 A and V 4 B of the two systems are generated using the two imaging units  3 A and  3 B. However, the present disclosure is not limited to this example, and may be applied to a case in which, when capturing a hologram image, for example, a chosen number of two or more of the imaging units  3 , such as three or eight of the imaging units  3 , are used to concurrently generate the image signals of the same imaging target. 
         [0214]    Further, in the above-described embodiments, cases are described in which the system controller  5  executes a specific imaging processing program and thus realizes the various functions shown in  FIG. 3 . However, the present disclosure is not limited to this example and the various functions may be realized by hardware. 
         [0215]    Further, in the above-described embodiments, cases are described in which the digital signal processing portions  27 A and  27 B, which are formed by digital signal processors, are programmed in advance and thus realize the various functions shown in  FIG. 3 . However, the present disclosure is not limited to this example, and the various functions may be realized by hardware. 
         [0216]    Further, in the above-described embodiments, cases are described in which the multiple image adjustment control program is stored in the non-volatile memory  14  in advance, and the extraction areas and the detection areas are set and the image signals are adjusted by reading out and executing this program. However, the present disclosure is not limited to this example, and a multiple image adjustment control program may be acquired from an external server or a host device etc. via a USB (Universal Serial Bus) connection or a LAN (Local Area Network) connection, and executed. 
         [0217]    Further, in the above-described second embodiment, a case is described in which the compound-eye imaging device  71  is configured as the image processing device by the optical axis correction control portions  41 A and  41 B as a first area setting portion, the parallax amount control portion  42  as a second area setting portion, and the detection area control portions  84 A and  84 B as a detection area setting portion. However, the present disclosure is not limited to this example, and the image processing device may be configured by the first area setting portion, the second area setting portion and the detection area setting portion that are configured in various other ways. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and alterations may occur depending on design requirements and other factors insofar as they are within the scope of the appended claims or the equivalents thereof. 
         [0218]    It should be noted that the present disclosure can also take the following configurations. 
         [0219]    (1) An image processing device comprising: 
         [0220]    a first area setting portion that sets a first area for each of images of two systems that are respectively captured from two different viewpoints; 
         [0221]    a second area setting portion that, for each of the images of the two systems, sets a second area based on the first area, the second area being used to adjust a stereoscopic effect that is imparted during stereoscopic viewing; and 
         [0222]    a detection area setting portion that, for each of the images of the two systems, sets a detection area based on the first area, the detection area being an area used to extract an image signal. 
         [0223]    (2) The image processing device according to (1), 
         [0224]    wherein the first area setting portion respectively sets the first area while taking as reference a position of an imaging target in the images of the two systems. 
         [0225]    (3) The image processing device according to (2), further comprising: 
         [0226]    an output image generation portion that generates an output image in accordance with an image signal obtained from the second area. 
         [0227]    (4) The image processing device according to (3), 
         [0228]    wherein the output image generation portion adjusts the image signal obtained from the second area, in accordance with an image signal obtained from the detection area, and generates the output image. 
         [0229]    (5) The image processing device according to (2), further comprising: 
         [0230]    an optical system control portion that changes a state of an optical system of an imaging portion in accordance with an image signal obtained from the detection area. 
         [0231]    (6) An image processing method comprising: 
         [0232]    setting a first area for each of images of two systems that are respectively captured from two different viewpoints, the first area being set by a first area setting portion; 
         [0233]    setting a second area based on the first area for each of the images of the two systems, the second area being used to adjust a stereoscopic effect that is imparted during stereoscopic viewing and being set by a second area setting portion; and 
         [0234]    setting a detection area based on the first area for each of the images of the two systems, the detection area being an area used to extract an image signal that expresses the second area and being set by a detection area setting portion. 
         [0235]    (7) An image processing program that causes an information processing device to execute: setting a first area for each of images of two systems that are respectively captured from two different viewpoints; 
         [0236]    setting a second area based on the first area for each of the images of the two systems, the second area being used to adjust a stereoscopic effect that is imparted during stereoscopic viewing; and 
         [0237]    setting a detection area based on the first area for each of the images of the two systems, the detection area being an area used to extract an image signal that expresses the second area. 
       INDUSTRIAL APPLICABILITY 
       [0238]    The present disclosure can be used in various business-use or household-use video cameras that perform compound-eye imaging, in digital still cameras or mobile telephones that have a moving image capture function, or in computer devices and the like. 
       REFERENCE SIGNS LIST 
       [0239]      1 ,  71  Compound-eye imaging device 
         [0240]      2  Control unit 
         [0241]      3 A,  3 B Imaging unit 
         [0242]      5 ,  75  System controller 
         [0243]      11  CPU 
         [0244]      20 A,  20 B Optical adjustment portion 
         [0245]      21 A,  21 B Zoom lens 
         [0246]      22 A,  22 B Aperture 
         [0247]      23 A,  23 B Focus lens 
         [0248]      24 A,  24 B Imaging element 
         [0249]      25 A,  25 B Analog signal processing portion 
         [0250]      27 A,  27 B Digital signal processing portion 
         [0251]      31 A,  31 B Lens driver 
         [0252]      32 A,  32 B Timing generator 
         [0253]      40 ,  80  Extraction/scaling control portion 
         [0254]      41 A,  41 B Optical axis correction control portion 
         [0255]      42  Parallax amount control portion 
         [0256]      43  Extraction area signal generation portion 
         [0257]      44 A,  44 B,  84 A,  84 B Detection area control portion 
         [0258]      45  Lens control portion 
         [0259]      46  Exposure control portion 
         [0260]      47  White balance control portion 
         [0261]      52 A,  52 B Detection portion 
         [0262]      52 A 1 ,  52 B 1  Sharpness detection portion 
         [0263]      52 A 2 ,  52 B 2  Luminance detection portion 
         [0264]      52 A 3 ,  52 B 3  Color signal detection portion 
         [0265]      53 A,  53 B White balance adjustment portion 
         [0266]      55 A,  55 B Extraction/scaling portion 
         [0267]    V 3 A, V 3 B, V 4 A, V 4 B Image signal 
         [0268]    JA, JB Imaging target 
         [0269]    TA 1 , TA 2 , TB 1 , TB 2  Extraction area 
         [0270]    DA 1 , DA 2 , DB 1 , DB 2  Detection area