Abstract:
There is provided an image synthesizing device. The device includes: an image capturing unit configured to capture a plurality of images that are temporally continuous; an image generator configured to generate a single synthesized image by adding pixels of the plurality of images; a first difference obtaining unit configured to obtain differences between the plurality of images on pixel-by-pixel basis for each of the plurality images; and a blending unit configured to employ the differences between the plurality of images as transparency information and blend the transparency information into the synthesized image.

Description:
CROSS-REFERENCE TO RELATED APPLICATION 
       [0001]    This application claims priority from Japanese Patent Application Nos. 2010-165968, filed on Jul. 23, 2010, and 2010-182677, filed on Aug. 18, 2010, the entire contents of which are hereby incorporated by reference. 
       BACKGROUND OF THE INVENTION 
       [0002]    1. Field of the Invention 
         [0003]    Embodiments described herein relate to an image synthesizing device, an image synthesizing method and a computer readable medium. 
         [0004]    2. Description of the Related Art 
         [0005]    In a related art, pixels of continuously captured images are added and synthesized, thereby generating an image having a sufficient brightness for recording even in an environment such as a night scene in which the amount of light is not sufficient. 
         [0006]    Further, an image synthesizing technique is disclosed in Japanese Unexamined Patent Application Publication No. 2006-148550. As disclosed in this document, in this image synthesizing technique, a fluctuation in image capture angle of view is corrected in performing image synthesis at the time of hand-held image capture in which a user captures an image by holding a camera by hand. 
         [0007]    However, in the case of the foregoing image synthesizing technique, when a moving object exists at an image capture angle of view, an image in which an afterimage of the moving object remains will be obtained even with the use of the foregoing image synthesizing technique. 
       SUMMARY 
       [0008]    According to one or more illustrative aspects of the present invention, there is provided an image synthesizing device. The device includes: an image capturing unit configured to capture a plurality of images that are temporally continuous; an image generator configured to generate a single synthesized image by adding pixels of the plurality of images; a first difference obtaining unit configured to obtain differences between the plurality of images on pixel-by-pixel basis for each of the plurality images; and a blending unit configured to employ the differences between the plurality of images as transparency information and blend the transparency information into the synthesized image. 
         [0009]    According to one or more illustrative aspects of the present invention, there is provided an image synthesizing method. The method includes: (a) capturing a plurality of images that are temporally continuous; (b) generating a single synthesized image by adding pixels of the plurality of images; (c) obtaining differences between the plurality of images on pixel-by-pixel basis for each of the plurality images; and (d) employing the differences between the plurality of images as transparency information and blending the transparency information into the synthesized image. 
         [0010]    According to one or more illustrative aspects of the present invention, there is provided a computer-readable medium storing a program for causing the computer to perform operations comprising: (a) capturing a plurality of images that are temporally continuous; (b) generating a single synthesized image by adding pixels of the plurality of images; (c) obtaining differences between the plurality of images on pixel-by-pixel basis for each of the plurality images; and (d) employing the differences between the plurality of images as transparency information and blending the transparency information into the synthesized image. 
         [0011]    Other aspects and advantages of the present invention will be apparent from the following description, the drawings and the claims. 
     
    
     
       BRIEF DESCRIPTION OF THE DRAWINGS 
         [0012]      FIG. 1  is a circuit block diagram of an image capture device according to a first embodiment of the present invention; 
           [0013]      FIG. 2  is a flow chart illustrating a procedure of processing performed by the image capture device; 
           [0014]      FIG. 3  is a flow chart illustrating a processing procedure of a moving object determination and α-blending process; 
           [0015]      FIG. 4  is a diagram illustrating examples of continuously captured images obtained by continuous shooting; 
           [0016]      FIG. 5A  is a diagram illustrating a processing example obtained by a smoothing process; 
           [0017]      FIG. 5B  is a diagram illustrating a processing example obtained by an enhancement process; 
           [0018]      FIG. 6A  illustrates a synthesized image obtained by addition and synthesis; 
           [0019]      FIG. 6B  illustrates a synthesized image in the present embodiment; 
           [0020]      FIG. 7  is a circuit block diagram of an image capture device according to a second embodiment of the present invention; 
           [0021]      FIG. 8  is a flow chart illustrating a procedure of processing performed by the image capture device according to the second embodiment; 
           [0022]      FIG. 9A  is a diagram illustrating an underexposure image of images obtained by continuously shooting images while changing an exposure condition in the second embodiment; 
           [0023]      FIG. 9B  is a diagram illustrating an overexposure image of images obtained by continuously shooting while changing the exposure condition in the second embodiment; 
           [0024]      FIG. 10A  is a diagram illustrating a processing example obtained by a smoothing process; 
           [0025]      FIG. 10B  is a diagram illustrating a processing example obtained by an enhancement process; and 
           [0026]      FIG. 11  is a flow chart illustrating a procedure of processing performed in a variation of the second embodiment. 
       
    
    
     DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
       [0027]    Hereinafter, exemplary embodiments of the present invention will be now described with reference to the drawings. 
       First Embodiment 
       [0028]      FIG. 1  is a circuit block diagram of an image capture device including an image synthesizing device according to a first embodiment of the present invention. The image capture device includes an image capture unit  1 , a drive controller  2 , a CDS/ADC  3 , a key input unit  4 , a display unit  5 , an image recorder  6 , a program memory  7 , a RAM  8 , a controller  9 , and an image processor  10 . These components are connected to each other via a bus line. The key input unit  4  includes a shutter key  41  for receiving a recording instruction from a person who captures an image, and the image processor  10  includes a synthesizer  11 . 
         [0029]    Referring to  FIG. 1 , the image capture unit  1  incorporates a driver for retaining, as accumulated electric charges, a light intensity for a given period of time and for outputting, as an analog image capture signal, the electric charges to the CDS/ADC  3  in accordance with control carried out using an image sensor such as a CMOS, RGB color filters provided on the image sensor, and the drive controller  2 . Further, the image capture unit  1  acquires a plurality of images (color images) when receiving an image capture instruction from a person, who captures an image, via the shutter key  41 , the controller  9  and the drive controller  2 . 
         [0030]    The CDS/ADC  3  is a circuit for receiving the analog image capture signal outputted from the image capture unit  1  and responsive to an optical image of an object. The CDS/ADC  3  includes components such as: a CDS for retaining the image capture signal; a gain control amplifier (GCA) for amplifying the image capture signal; and an A/D converter (ADC) for converting the amplified image capture signal into a digital image capture signal. It should be noted that control concerning gain control amplifier adjustment is also carried out in response to an instruction provided from the drive controller  2 . Therefore, even when a plurality of images are acquired under the same exposure condition (shutter speed or F-number), generation of a plurality of images, for which conditions are different, is enabled by sequentially changing RGB gain control amplifiers and/or color shades of images. 
         [0031]    In the present embodiment, the control concerning the gain control amplifier is carried out by the drive controller  2 , but the present invention is not limited thereto. For example, the foregoing control may be carried out by the controller  9 . 
         [0032]    The key input unit  4  includes, in addition to the foregoing shutter key  41 , various keys for detecting switching to an image capture mode for image acquisition/recording according to the present invention, display switching, etc. 
         [0033]    The display unit  5  has the function of displaying a synthesized image. After a synthesizing process according to the present invention has been executed, the image recorder  6  stores or holds image data (image file) encoded in a JPEG format. The program memory  7  stores a program executed by the controller  9  and/or the image processor  10 , and this program is read by the controller  9  when necessary. The RAM  8  has the function of temporarily retaining data that is generated by each process and is being processed. The controller  9  controls processing operations of the entire image capture device. The image processor  10  includes the synthesizer  11  associated with features of the present invention in addition to image data encoding/decoding processing. 
         [0034]    Specifically, the synthesizer  11  synthesizes a single reference image, selected from continuously captured images, with a synthesized image obtained by addition and synthesis of the continuously captured images, and uses, for the resulting synthesized image, an after-mentioned moving object determination map as a transparency map (a map) provided for a difference region, thus reducing an afterimage caused by a moving object. 
         [0035]    Next, operations performed in the first embodiment will be described. When a user has operated a mode button provided in the key input unit  4  and set the image capture mode according to the present embodiment, the controller  9  reads the program from the program memory  7 , and starts processing as illustrated in a flow chart of  FIG. 2 . 
         [0036]    Specifically, the controller  9  determines whether or not pressing of the shutter key  41  is detected (Step S 101 ). Upon detection of the pressing of the shutter key  41 , an instruction is provided to the drive controller  2  to execute continuous capture of N images (Step S 102 ). Subsequently, based on image data obtained by the continuous capture, continuously captured images, consisting of YUV images represented by color space information of brightness/color difference, are generated and stored in the RAM  8  (Step S 103 ). 
         [0037]    For example, when the number N of the continuously captured images is six, six continuously captured images P 1  to P 6  consisting of YUV images are stored in the RAM  8  as illustrated in  FIG. 4 . In  FIG. 4 , an arrow t represents a time axis, and the continuously captured images P 1  to P 6  are obtained by continuous capture performed at substantially the same image capture angle of view in a state where a hand H serving as a moving object is waved up and down in a background B representing the entire image capture angle of view. For the continuously captured images P 1  to P 6 , the background B is the same; however, an image of the hand H is located at a relatively higher position in the background B in accordance with a lapse of the time t (P 1 →P 2 →P 3 ), and the image of the hand H in the image P 3  is located at the highest position. Furthermore, the image of the hand H is located at a relatively lower position in the background B in accordance with a lapse of the time t (P 3 →P 4 →P 5 →P 6 ), and the image of the hand H in the image P 6  is located at the lowest position. 
         [0038]    Note that in the continuous capture of the continuously captured images P 1  to P 6 , an image motion blur caused by camera shake is corrected by a known technique (e.g., a technique for correcting an angle of view by CCD shift or lens shift). 
         [0039]    Next, a reference image is selected from the continuously captured images (Step S 104 ). In selecting the reference image, an image in which the amount of motion of the moving object is the smallest is selected from the continuously captured images. Accordingly, from the continuously captured images P 1  to P 6 , the image at a turning point at which the image of the hand H that has moved from a downward position to an upward position starts to move from the upward position to the downward position is selected as the image in which the amount of motion of the moving object (image of the hand H) is the smallest. In other words, the continuously captured image P 3 , in which the image of the hand H is located at the relatively highest position, is selected as the reference image. 
         [0040]    Thereafter, using a LPF (low-pass filter), a noise reduction process is performed on image data of the selected reference image (Step S 105 ). Then, YUV image data of the reference image on which the noise reduction process has been performed is temporarily stored in the RAM  8  (Step S 106 ). Accordingly, in the example illustrated in  FIG. 4 , the image data of the continuously captured image P 3  is subjected to the noise reduction process by the process of Step S 105 , and the resulting YUV image data is stored in the RAM  8  by the process of Step S 106 . 
         [0041]    Further, a plurality of the continuously captured images are subjected to noise reduction and synthesized (Step S 107 ). Specifically, when the YUV image data of the plurality of continuously captured images is added and averaged on a pixel-by-pixel basis, the images are allowed to be synthesized while being subjected to noise reduction. Equations (1) to (3) for addition and averaging of the YUV image data of the plurality of continuously captured images, i.e., the N continuously captured images, are provided below. It should be noted that Y_result, U_result and V_result represent information of respective pixel brightness/color difference parameters, obtained after the synthesis. 
         [0000]        Y _result=( Y[ 0 ]+Y[ 1 ]+ . . . +Y[N ])/ N   (1)
 
         [0000]        U _result=( U[ 0 ]+U[ 1 ]+ . . . +U[N ])/ N   (2)
 
         [0000]        V _result=( V[ 0 ]+V[ 1 ]+ . . . +V[N ])/ N   (3)
 
         [0042]    Naturally, a processing method in this case is not limited to addition and averaging but any other processing method may be used as long as it is a synthesizing method in which a plurality of continuously captured images are used and a noise reduction effect is achieved. Then, the YUV image data of the synthesized image of the whole continuously captured images, on which noise reduction has been performed, is temporarily stored in the RAM  8  (Step S 108 ). 
         [0043]    Accordingly, at the time when the process of Step S 108  is ended, the following image data is temporarily stored in the RAM  8 . 
         [0044]    (1) YUV image data of each continuously captured image 
         [0045]    (2) YUV image data of the reference image on which the noise reduction process has been performed 
         [0046]    (3) YUV image data of the synthesized image on which the noise reduction process has been performed 
         [0047]    Then, a process for synthesizing the YUV image data ( 2 ) of the reference image with the YUV image data ( 3 ) of the synthesized image is performed in such a manner that a moving object determination and α-blending process of the subsequent step, i.e., Step S 109 , is included. 
         [0048]      FIG. 3  is a flow chart illustrating a processing procedure of the moving object determination and α-blending process (Step S 109 ). In the flow chart illustrated in  FIG. 3 , the following equations, codes or functions will be used (see Table 1). 
         [0000]    
       
         
               
               
             
           
               
                 TABLE 1 
               
               
                   
               
               
                 Equations, 
                   
               
               
                 Codes or Functions 
                 Explanation 
               
               
                   
               
             
             
               
                 Y_Base_Nr, U_Base_Nr, 
                 Respective YUV parameters of the data (2) 
               
               
                 V_Base_Nr 
                 of the reference image on which the noise 
               
               
                   
                 reduction has been performed 
               
               
                 V[n], U[n], V[n] 
                 Respective YUV parameters of the n-th 
               
               
                   
                 image data 
               
               
                 N 
                 The number of images that are synthesized 
               
               
                 fMax( ) 
                 Maximum value calculation function 
               
               
                 fLpf( ) 
                 Smoothing function 
               
               
                 fEmphasis( ) 
                 Map emphasis function 
               
               
                   
               
             
          
         
       
     
         [0049]    Referring to the flow chart of  FIG. 3 , a difference absolute value between the YUV image data ( 2 ) of the reference image on which the noise reduction process has been performed and the YUV image data ( 1 ) of each continuously captured image is obtained by the controller  9  on a pixel-by-pixel basis for the YUV image data ( 1 ) of each continuously captured image as indicated by the following equations (4) to (6) (Step S 201 ). 
         [0000]      Diff —   Y[n]=|Y _Base —   Nr−Y[n]|   (4)
 
         [0000]      Diff —   U[n]=|U _Base —   Nr−U[n]|   (5)
 
         [0000]      Diff —   V[n]=|V _Base —   Nr−V[n]|   (6)
 
         [0050]    In other words, the foregoing difference absolute values are obtained on a pixel-by-pixel basis for each continuously captured image. 
         [0051]    Furthermore, the greater the difference, the more likely it is that a region associated therewith is a region where the object is moved, and therefore, the difference absolute value at which the difference is maximized (at which the difference is maximized for the respective corresponding pixels of the continuously captured images) as indicated by the following equation (7) is selected (Step S 202 ). 
         [0000]      Diff[ n]=f Max(Diff —   Y[n ],Diff —   U[n ],Diff —   V[n ])  (7)
 
         [0052]    Next, as indicated by the following equation (8), a process for averaging maximum differences of the respective continuously captured images except the reference image is executed (Step S 203 ). 
         [0000]      Ave_Diff=(Diff[0]+Diff[1]+ . . . +Diff[ n ])/ N− 1  (8)
 
         [0053]    Moreover, as indicated by the following equation (9), a smoothing process is executed (Step S 204 ). 
         [0000]      Ave_Diff —   Lpf=fLpf (Ave_Diff)  (9)
 
         [0054]    As a result of the smoothing process in Step S 204 , a moving object determination map M is generated as illustrated in  FIG. 5A . In the moving object determination map M, a region indicated by oblique lines is a region where α=0 and total transmission is allowed, and a void region is a region where α=255 and transmission is not allowed. 
         [0055]    Subsequently, as indicated by the following equation (10), an enhancement process is performed to increase a contrast of the moving object determination map M (Step S 205 ). 
         [0000]      Map_Move= f Emphasis(Ave_Diff —   Lpf )  (10)
 
         [0056]    As a result of the enhancement process in Step S 205 , the contrast of a region of the moving object determination map M where the images of the hands H serving as the moving objects are overlapped is increased as illustrated in  FIG. 5B . 
         [0057]    Then, finally, using the moving object determination map M (Map_Move [0255]: 0=no moving object) illustrated in  FIG. 5B  as an α map, the foregoing YUV image data ( 2 ) of the reference image on which the noise reduction process has been performed is synthesized with the YUV image data ( 3 ) of the synthesized image on which the noise reduction process has been performed (Step S 206 ). 
         [0058]    The respective YUV parameters (Y_result, U_result, and V_result) for the respective synthesized pixels are represented by the following equations (11) to (13). 
         [0000]        Y _result=( Y   —   Nr _Mix×(255−Map_Move)+ Y _Base —   Nr×Map _Move)/255  (11)
 
         [0000]        U _result=( U   —   Nr _Mix×(255−Map_Move)+ U _Base —   Nr×Map _Move)/255  (12)
 
         [0000]        V _result=( V   —   Nr _Mix×(255−Map_Move)+ V _Base —   Nr×Map _Move)/255  (13)
 
         [0059]    Thus, as illustrated in  FIG. 6B , YUV image data representing a synthesized image PM including the background B and the hand H is generated. 
         [0060]    For the purpose of comparison,  FIG. 6A  illustrates a synthesized image PN obtained simply by performing an averaging and addition process on the continuously captured images. 
         [0061]    As illustrated in  FIG. 6A , in the synthesized image PN obtained simply by performing an averaging and addition process on the continuously captured images, a large motion blur occurs in the image of the hand H serving as a moving object image. On the other hand, according to the present embodiment, the synthesized image PM in which a motion blur of the moving object is small may be obtained as illustrated in  FIG. 6B  even when the image of the hand H is moved. 
         [0062]    Besides, since the smoothing process is performed in Step S 204  as mentioned above, a boundary between the moving object (hand H) and the background, which is created by the synthesis, is allowed to be more natural. 
         [0063]    In addition, the process for increasing the contrast of the map M is executed in Step S 205  described above, thus also enabling a reduction in afterimage (ghost image) caused by a motion blur in the synthesizing process. 
         [0064]    The YUV image data representing the synthesized image PM is generated in the above-described manner, thus completing the moving object determination and α-blending process in the flow chart of  FIG. 2 ; then, the YUV image data of the synthesized image PM serving as a completed image is encoded in a JPEG format and converted into a file, and is recorded and stored in the image recorder  6  (Step S 110 ), thus ending the processing. 
       Second Embodiment 
       [0065]    In the first embodiment, the case where the influence of a motion blur of the moving object is reduced when a plurality of images obtained by continuous capture are simply synthesized has been described, but the present invention is not limited thereto. The present invention is applicable to other cases as long as images are continuously captured, and is thus also applicable to a case where images, which are continuously captured while an exposure condition is changed, are synthesized and an image with an increased dynamic range is generated. 
         [0066]    The following description of the second embodiment will be made on an example in which the invention of the present application is applied to a case where images, which are continuously captured while an exposure condition is changed, are synthesized and an image with an increased dynamic range is generated. 
         [0067]    In the following circuit configuration and flow chart, components similar to those of the first embodiment are identified by the same reference characters or numerals in the second embodiment, and the description thereof will be omitted. 
         [0068]      FIG. 7  is a circuit block diagram of an image capture device including an image synthesizing device according to the second embodiment. The second embodiment differs from the first embodiment in that a program memory  17  and a synthesizer  12  are provided instead of the program memory  7  and the synthesizer  11 . 
         [0069]    The program memory  17  stores a program executed by the controller  9 , the image processor  10  and the synthesizer  12 , and this program is read by the controller  9  when necessary. 
         [0070]    Further, the synthesizer  12  executes synthesis of an overexposure image and a pseudo overexposure image (described later), and uses, for the resulting synthesized image, an moving object determination map as a transparency map (a map) provided for a difference region, thus reducing an afterimage caused by a moving object. Furthermore, pixels of the synthesized image and an underexposure image are added and synthesized, thereby increasing a dynamic range. 
         [0071]    Next, operations performed in the second embodiment will be described with reference to  FIG. 8 . When a user has operated a mode button provided in the key input unit  4  and set the image capture mode according to the present embodiment, the controller  9  reads the program from the program memory  17 , and starts processing as illustrated in the flow chart of  FIG. 8 . 
         [0072]    Specifically, the controller  9  determines whether or not pressing of the shutter key  41  is detected (Step S 301 ). Upon detection of the pressing of the shutter key  41 , an appropriate exposure is detected; in addition, an instruction is provided to the drive controller  2  to execute image capture at an exposure value of −1 EV, which is reduced by “1” from an exposure value of 0 EV for the appropriate exposure, and an underexposure image obtained by the image capture at −1 EV is temporarily stored in the RAM  8  (Step S 302 ). Subsequently, an instruction is provided to the drive controller  2  to execute image capture at an exposure value of +1 EV, which is increased by “1” from an exposure value of 0 EV for the appropriate exposure, and an overexposure image obtained by the image capture at +1 EV is temporarily stored in the RAM  8  (Step S 303 ). 
         [0073]    Accordingly, an underexposure image U illustrated in  FIG. 9A  and including an YUV image and an overexposure image O illustrated in  FIG. 9B  and including a YUV image are stored in the RAM  8  by the processes of Steps S 302  and S 303 , respectively (in addition, an image captured at an appropriate exposure may naturally be obtained). The continuously captured underexposure image U and overexposure image O are continuously captured at substantially the same image capture angle of view in a state where the hand H serving as the moving object is waved up and down in the background B representing the entire image capture angle of view. 
         [0074]    The background B of the image U is the same as that of the image O, but the image of the hand H in the previously captured overexposure image O is located at a position lower than that of the image of the hand H in the subsequently captured underexposure image U. 
         [0075]    Note that in the continuous capture of the continuously captured images U and O, an image motion blur caused by camera shake is corrected by a known technique (e.g., a technique for correcting an angle of view by CCD shift or lens shift). 
         [0076]    Next, a gain of the underexposure image U is increased so that the exposure condition thereof is equivalent to that of the overexposure image O; thus, a pseudo overexposure image thereof is generated and temporarily stored in the RAM  8  (Step S 304 ). Specifically, there is a fourfold difference between an image brightness of the underexposure image U captured at −1 EV and that of the overexposure image O captured at +1 EV, and the brightness of the overexposure image O is four times as high as that of the underexposure image U. Accordingly, the underexposure image U is processed at a fourfold digital gain, thereby generating the pseudo overexposure image whose exposure condition is tentatively equal to that of the overexposure image O. 
         [0077]    Subsequently, a moving object determination and α-blending process is performed (Step S 305 ). This moving object determination and/α-blending process is generally similar to that performed in Step S 109  in the first embodiment, and a general process flow thereof is similar to that described with reference to  FIG. 3 . In the description of the flow chart of  FIG. 3 , the following equations, codes or functions will be used instead of the equations, codes or functions of the first embodiment (see TABLE 2). 
         [0000]    
       
         
               
               
             
           
               
                 TABLE 2 
               
               
                   
               
               
                 Equations, 
                   
               
               
                 Codes or Functions 
                 Explanation 
               
               
                   
               
             
             
               
                 Y_Under_4, U_Under_4, 
                 YUV parameters of a pseudo overexposure 
               
               
                 V_Under_4 
                 image 
               
               
                 Y_Over, U_Over, 
                 YUV parameters of an overexposure image 
               
               
                 V_Over 
               
               
                 fMax( ) 
                 Maximum value calculation function 
               
               
                 fLpf( ) 
                 Smoothing function 
               
               
                 fEmphasis( ) 
                 Map emphasis function 
               
               
                   
               
             
          
         
       
     
         [0078]    Further, in Step S 201  of the flow chart of  FIG. 3 , the controller  9  obtains a difference absolute value between the overexposure image and the pseudo overexposure image on a pixel-by-pixel basis for both of the images as indicated by the following equations (14) to (16). 
         [0000]      Diff —   Y=|Y _Under — 4 −Y _Mid|  (14)
 
         [0000]      Diff —   U=|U _Under — 4 −U _Mid|  (15)
 
         [0000]      Diff —   V=|V _Under — 4 −V _Mid|  (16)
 
         [0079]    In other words, the foregoing difference absolute values are obtained on a pixel-by-pixel basis for both of the images. 
         [0080]    Furthermore, the greater the difference, the more likely it is that a region associated therewith is a region where the object is moved, and therefore, the difference absolute value at which the difference is maximized (at which the difference is maximized for the respective corresponding pixels of both of the images) as indicated by the following equation (17) is selected in Step S 202 . 
         [0000]      Diff= f Max(Diff —   Y ,Diff —   U ,Diff —   V )  (17)
 
         [0000]    Next, as indicated by the following equation (18), a process for averaging maximum differences of both of the images is executed in Step S 203 . 
         [0000]      Ave_Diff=(Diff[0]+++Diff[ n ])/ N− 1  (18)
 
         [0081]    Moreover, as indicated by the following equation (19), a smoothing process is executed in Step S 204 . 
         [0000]      Diff —   Lpf=fLpf (Diff)  (19)
 
         [0082]    As a result of the smoothing process in Step S 204 , a moving object determination map M is generated as illustrated in  FIG. 10A . In the moving object determination map M, a region indicated by oblique lines is a region where α=0 and total transmission is allowed, and a void region is a region where α=255 and transmission is not allowed. 
         [0083]    Subsequently, as indicated by the following equation [20], an enhancement process is performed to increase a contrast of the moving object determination map M in Step S 205 . 
         [0000]      Map_Move= f Emphasis(Diff —   Lpf )  (20)
 
         [0084]    As a result of the enhancement process in Step S 205 , the contrast of a region of the moving object determination map M where the images of the hands H serving as the moving objects are located is increased as illustrated in  FIG. 10B . 
         [0085]    Thereafter, using the moving object determination map M (Map_Move [0{tilde over ( )}255]: 0=no moving object) illustrated in  FIG. 10B  as an α map, the foregoing pseudo overexposure image and the overexposure image are synthesized in Step  206 . 
         [0086]    The respective YUV parameters (Y_result_Over, U_result_Over, and V_result_Over) for the respective pixels of the synthesized image (hereinafter referred to as a “blending image”) are represented by the following equations (21) to (23). 
         [0000]        Y _result_Over=( Y _Over×(255−Map_Move)+ Y _Under — 4×Map_Move)/255  (21)
 
         [0000]        U _result_Over=( U _Over×(255−Map_Move)+ U _Under — 4×Map_Move)/255  (22)
 
         [0000]        V _result_Over=( V _Over×(255−Map_Move)+ V _Under — 4×Map_Move)/255  (23)
 
         [0087]    Then, in Step S 306  subsequent to Step S 305  in the flow chart of  FIG. 8 , the blending image is temporarily stored in the RAM  8 . Subsequently, the pixels of the blending image temporarily stored in the RAM  8  and the underexposure image U are added and synthesized (Step S 307 ). 
         [0088]    Upon generation of the YUV image data representing the synthesized image PM as described above, the YUV image data of the synthesized image PM serving as a completed image is encoded in a JPEG format and converted into a file, and is recorded and stored in the image recorder  6  (Step S 308 ), thus ending the processing. 
       Variation of Second Embodiment 
       [0089]      FIG. 11  is a flow chart illustrating a procedure of processing in a variation of the second embodiment, in which three images, i.e., an underexposure image, an appropriate exposure image and an overexposure image, captured at substantially the same angle of view are used. When a user has operated a mode button provided in the key input unit  4  and set the image capture mode according to the present embodiment, the controller  9  reads the program from the program memory  17 , and starts processing as illustrated in the flow chart. 
         [0090]    Specifically, the controller  9  determines whether or not pressing of the shutter key  41  is detected (Step S 401 ). Upon detection of the pressing of the shutter key  41 , an appropriate exposure is detected; in addition, an instruction is provided to the drive controller  2  to execute image capture at an exposure value of −2 EV, which is reduced by “2” from an exposure value of 0 EV for the appropriate exposure, and an underexposure image obtained by the image capture at −2 EV is temporarily stored in the RAM  8  (Step S 402 ). 
         [0091]    Furthermore, an instruction is provided to the drive controller  2  to execute image capture at an exposure value of 0 EV for the appropriate exposure, and an appropriate exposure image obtained by the image capture at 0 EV is temporarily stored in the RAM  8  (Step S 403 ). Moreover, an instruction is provided to the drive controller  2  to execute image capture at an exposure value of +2 EV, which is increased by “2” from an exposure value of 0 EV for the appropriate exposure, and an overexposure image obtained by the image capture at +2 EV is temporarily stored in the RAM  8  (Step S 404 ). 
         [0092]    Accordingly, the underexposure image, appropriate exposure image and overexposure image, each including a YUV image, are stored in the RAM  8  by the processes of Steps S 402 , S 403  and S 404 , respectively. 
         [0093]    Next, a gain of the underexposure image is increased so that the exposure condition thereof is equivalent to that of the appropriate exposure image, and a first pseudo overexposure image is thus generated and is temporarily stored in the RAM  8 ; in addition, a gain of the underexposure image is increased so that the exposure condition thereof is equivalent to that of the overexposure image, and a second pseudo overexposure image is thus generated and is temporarily stored in the RAM  8  (Step S 405 ). 
         [0094]    Specifically, there is an eightfold difference between an image brightness of the underexposure image captured at −2 EV and that of the appropriate exposure image captured at 0 EV, and therefore, the brightness of the appropriate exposure image is eight times as high as that of the underexposure image. Accordingly, the underexposure image is processed at an eightfold digital gain, thereby generating the first pseudo overexposure image whose exposure condition is tentatively equal to that of the appropriate exposure image. 
         [0095]    Further, there is a 16-fold difference between the image brightness of the underexposure image captured at −2 EV and that of the overexposure image captured at +2 EV, and therefore, the brightness of the overexposure image is 16 times as high as that of the underexposure image. Accordingly, the underexposure image is processed at a 16-fold digital gain, thereby generating the second pseudo overexposure image whose exposure condition is tentatively equal to that of the overexposure image. Then, the first and second pseudo overexposure images are temporarily stored in the RAM  8 . 
         [0096]    Subsequently, it is determined whether or not a first moving object determination and α-blending process is ended (Step S 406 ). When the moving object determination and α-blending process has not yet been executed and the moving object determination and α-blending process to be performed this time is the first one, the determination made in Step S 406  is “NO”, and the processing goes to Step S 407 . 
         [0097]    Then, the moving object determination and α-blending process is performed using the first pseudo overexposure image and the appropriate exposure image for which tentatively equal exposure values are used. A process procedure of this moving object determination and α-blending process (Step S 407 ) is similar to that described in the foregoing embodiment with reference to the flow chart of  FIG. 3 . Upon end of the moving object determination and α-blending process performed using the first pseudo overexposure image and the appropriate exposure image, a first blending image obtained by this process is temporarily stored in the RAM  8  (Step S 408 ), and the processing goes back to Step S 406 . 
         [0098]    Then, since the first moving object determination and α-blending process has ended, the determination made in Step S 406  is “YES”. Accordingly, the processing goes to Step S 409  to perform another moving object determination and α-blending process using the overexposure image and the second pseudo overexposure image for which tentatively equal exposure values are used. A process procedure of this moving object determination and α-blending process (Step S 409 ) is also similar to that described in the foregoing embodiment with reference to the flow chart of  FIG. 3 . 
         [0099]    Upon end of the moving object determination and α-blending process performed using the overexposure image and the second pseudo overexposure image, a second blending image obtained as a result of this process is temporarily stored in the RAM  8  (Step S 410 ). 
         [0100]    Subsequently, pixels of the first blending image, the second blending image and the underexposure image, which have temporarily been stored in the RAM  8 , are added and synthesized, thereby generating YUV image data representing the resulting synthesized image (Step S 411 ). 
         [0101]    Thereafter, the YUV image data of the synthesized image PM serving as a completed image is encoded in a JPEG format and converted into a file, and is recorded and stored in the image recorder  6  (Step S 412 ), thus ending the processing. 
         [0102]    In this variation, the pixels of the first blending image, the second blending image and the underexposure image are added and synthesized in Step S 411  so as to obtain the completed image. However, the pixels of only the first blending image and the underexposure image may be added and synthesized so as to obtain the completed image, or the pixels of the second blending image and the underexposure image may be added and synthesized so as to obtain the completed image. 
         [0103]    Although the case where YUV image data is used has been described in the foregoing embodiments, RGB image data may alternatively be used. In that case, a square difference is similarly calculated for each of RGB components.