Abstract:
An image data processing method to capture still images while capturing motion images is disclosed. The method includes stopping a motion image capturing according to a first instruction to generate a first motion image data with a first resolution, thereafter, carrying out live view at a predetermined time; outputting the image data in the predetermined time and generating a first temporal motion data with a second resolution; capturing a still image data according to a second instruction after the predetermined time; transforming the first temporal motion data and the still image data and generating a second motion image data by combining the transformed data with the first motion image data. 
     The method and device according to the present invention can be used in a camera to capture still images while capturing motion images.

Description:
CROSS REFERENCE TO RELATED APPLICATIONS 
       [0001]    This Application claims priority of Taiwan Patent Application No. 096149227, filed on Dec. 21, 2007, the entirety of which is incorporated by reference herein. 
       BACKGROUND OF THE INVENTION 
       [0002]    1. Field of the Invention 
         [0003]    The present invention relates to an image processing method, and more particularly to an image data processing method to capture still images while capturing motion images. 
         [0004]    2. Description of the Related Art 
         [0005]    Image capturing technology developed from capturing still images to capturing motion images. Capturing and recording of conventional motion images is performed by successively capturing a plurality of frames, i.e., still images. If a user wants to capture some frames of motion images or compare or analyze still images, the convention image capture method captures a plurality of frames of the motion images. Still images can be output in the form of a picture and can be edited by software. 
         [0006]    Please refer to  FIG. 1 .  FIG. 1  is a schematic diagram of a conventional motion image file. Typically, the conventional motion image file is made up of a plurality of frames of serially connected still images f 1 ˜fn. The still images f 1 ˜fn are captured with VGA resolution, thus, the resolution of the still images f 1 ˜fn is 640×480 pixels. A first motion image file is made up of serially connected still images f 1 ˜fn with the resolution of 640×480 pixels. If a still image capture operation is applied to the first motion image file, the resolution of the captured still image can only be as high as 640×480 pixels due to the resolution of the original still images f 1 ˜fn, thus possibly not meeting a users demand. 
         [0007]    A still image capture device that captures still images while capturing motion images is disclosed in U.S. Pub. No. 2004/0109067A1. The image capture device copies the last still image output by the image capture element inside of the image capture device, and the last still image is filled to compensate the lost part of the motion image file. Thus, minimally influencing the quality of smooth showing when playing the motion image file. However, if the capturing time of the still image capture operation is too long, i.e., the interrupt time of capturing the motion images may be too long, and accordingly the motion image data may be loss. Thus, when viewing the motion image data, the quality of smooth showing would be negatively affected as too many same still images would be used as compensation for the motion image data. Therefore, the above described capturing method, given the examples of the motion image file, results in a poorer smooth showing quality. As such, an image processing method capable of improving the quality of the motion image file is desirable. 
       BRIEF SUMMARY OF THE INVENTION 
       [0008]    An embodiment of the invention provides an image processing method comprising the following steps: 1) stopping captruring motion image according to a first instruction to generate a first motion image data with a first resolution, thereafter, carrying out live view at a predetermined time; 2) outputting the previewed first motion image data at the predetermined time and generating a first temporal motion data with a second resolution; 3) capturing a still image data according to a second instruction after the predetermined time; 4) transforming the first temporal motion data and the still image data, and generating a second motion image data by combining the transformed data with the first motion image data. 
         [0009]    Another preferred embodiment uses the image data when previewing the still images and uses the acquired still image data to compensate for the lost image data of the first motion image data when the still image is being captured. The compensation method calculates the number of frames, P, according to the frame rate of the first motion image, n, and the acquisition time of the still image, m, where P=m×n. The image capture device copies and generates P frames of the still image and combines the P frames of the still image with the first temporal data to generate a second motion data. 
         [0010]    According to the described image processing device, even if the still image capture operation is long, the phenomenon of the discontinuous image can be avoided. 
         [0011]    The embodiments of the invention provide an effective image process method to capture high resolution still images when capturing the motion images, and according to the image processing device of the embodiments, a video file is also acquired with the same image quality of the motion image data. 
         [0012]    A detailed description is given in the following embodiments with reference to the accompanying drawings. 
     
    
     
       BRIEF DESCRIPTION OF THE DRAWINGS 
         [0013]    The present invention can be more fully understood by reading the subsequent detailed description and examples with references made to the accompanying drawings, wherein: 
           [0014]      FIG. 1  is a schematic diagram of a conventional motion image file. 
           [0015]      FIG. 2A  shows a schematic diagram of the operation of an embodiment of an image capture device, and more particularly, of the operation where a frame of a still image is captured during two processes of capturing a motion image REC 1  and REC 2 . 
           [0016]      FIG. 2B  shows the output of the image capture device corresponding to the operation in  FIG. 2A . 
           [0017]      FIG. 2C  shows a schematic timing diagram of the operation of the image capture device 
           [0018]      FIG. 2D  is a schematic diagram of a motion data. 
           [0019]      FIG. 3  is a circuit diagram of an embodiment of an image capture device according to the invention. 
           [0020]      FIG. 4  is a flowchart of an embodiment of an image data processing method to capture still images while capturing motion images in accordance with the invention. 
       
    
    
     DETAILED DESCRIPTION OF THE INVENTION 
       [0021]    The following description is of the best-contemplated mode of carrying out the invention. This description is made for the purpose of illustrating the general principles of the invention and should not be taken in a limiting sense. The scope of the invention is best determined by reference to the appended claims. 
         [0022]    The embodiment of the present invention relates to a still image capture method and device to capture still images while capturing motion images, wherein the still image capture method and device can be applied in an image capture device. 
         [0023]      FIG. 2A  shows a schematic diagram of the operation of an embodiment of an image capture device, and more particularly, of the operation where a frame of a still image is captured during two processes of capturing a motion image REC 1  and REC 2 . Before the still image capture process SIC 1 , the image capture device executes a first still image preview process PI 1 , and executes the still image capture process SIC 1  when receiving an instruction. 
         [0024]      FIG. 2B  shows the output of the image capture device corresponding to the operation in  FIG. 2A . An image capture element sequentially outputs a first motion image R 1 , a first temporal motion data P 1  and a first still image data S 1 . The image capture element outputs the first motion image R 1  when the first motion image is being captured REC 1 . The image capture element outputs the first temporal motion data P 1  during the first still image preview process PI 1 . The image capture element outputs the first still image data S 1  during the still image capture process SIC 1  and then outputs a second motion data R 2  when the second motion image is being captured REC 2 . 
         [0025]    As shown in  FIG. 2C , a schematic timing diagram of the operation of the image capture device is provided. In reference also with  FIGS. 2A and 2B , at a time T 0 , a user presses a shutter button to send a start instruction and accordingly the image capture device starts executing the process for capturing a first motion image REC 1 . At time T 1 , when the shutter button is half-pressed, a first instruction is sent and the image capture device accordingly starts executing the first still image preview process PI 1 . At time T 2 , when the shutter is pressed down after being half-pressed, a second instruction is sent and the image capture device accordingly starts executing the still image capture process SIC 1  to capture the first still image data S 1 . At time T 3 , the image capture device is automatically switched to the function of capturing a motion image to execute the second process of capturing a motion image REC 2  to output the second motion data R 2 . At time T 4 , when the shutter button is pressed down again, a finish instruction is sent and consequently the second operation of capturing a motion image REC 2  is stopped and the image capture device switches to a standby mode. 
         [0026]      FIG. 2D  is a schematic diagram of a motion data. When the image capture device executes the process of capturing a motion image, the motion data is made up of a plurality of serial frames, f 1 ˜fn+n. 
         [0027]    Specifically, the image capture device is in the standby mode before a start instruction be sent and the process of capturing a motion image. At this time, the output image data of the image capture device is only displayed by a display unit and the image data is not stored in the image capture device. At time T 0 , the shutter button is pressed down, a start instruction is accordingly sent and the image capture device executes the first process of capturing a motion image REC 1 . During the REC 1  process, the image capture device outputs a first motion data R 1  with a first resolution. The image capture device processes the first motion data R 1  to sequentially generate a plurality of serial frames, f 1 ˜fn+n, with the first resolution according to a predetermined rate, wherein the first resolution may be 640 pixel×480 pixel. At time T 1 , the shutter button is half-pressed to sent the first instruction, the image capture device accordingly stops the first capturing a motion image REC 1  process, and processes the motion data to generate a first motion data R 1  with the first resolution. The frame rate of the first motion data R 1  is n frames/second, wherein one preferred embodiment of n is 30. During the first still image preview process PI 1 , the image capture device have some operation, for example a focusing, a white balance correcting, exposure value calculating, and so on, and generate and store a first temporal motion data P 1  with a second resolution, wherein one preferred embodiment of the second resolution is 720 pixel×480 pixel. At time T 2 , the shutter is pressed further after being half-pressed and a second instruction is sent to execute the still image capture process SIC 1  to capture the first still image data S 1  with a third resolution, wherein the third resolution is determined based on the size of the image sensor in the image capture device, wherein the third resolution may be 3648 pixel×2736 pixel or 3264 pixel×2448 pixel. After m seconds, the still image is completely output and the second operation of capturing a motion image REC 2  is automatically executed to output the second motion data R 2 , wherein m is the capture time of the still image data and m may be 1, 1.2 or 2.3 seconds. The image capture device processes the first still image data S 1  to generate a still image file and processes the frames fn+4˜fn+7 of the first still image data S 1  to generate a second temporal image data with the first resolution. The frame rate is n frames/second. The image capture device further converts the first temporal data P 1  to a preview image data with the first resolution, wherein the first temporal data corresponds to the frames fn+2˜fn+3. The image capture device sequentially combines the first motion data R 1 , the preview image data converted from the first temporal data P 1  and the second temporal image data converted from the first still image data S 1  to generate a second motion data. At time T 3 , when the shutter button is pressed down, the image capture device stops the motion data capturing operation and returns to a standby mode. 
         [0028]    The generation method of the second temporal motion data comprises the following steps: 1) calculating the number P of frames of motion data during the capturing time of the still image data; 2) converting the first still image data S 1  to data with the first resolution; and 3) duplicating and serially connecting the P frames to generate the second temporal motion data. More specifically, the number P of frames of the second temporal motion data can be calculated by the equation, P=m*n. It assumed that the still image data is captured for a capturing time, m seconds, and recording motion data with a frame rate of n frames/second, the number P of frames of the second temporal motion data can be calculated by the aforementioned equation, P=m*n. For example, if the frame rate of the motion data is 30 frames/second, and the capturing time is 2 seconds, the number P of frames of the still image data is 60 (2×30). This also representes that the motion data has 60 frames during the capturing time of 2 seconds. 
         [0029]    The resolution of the output image from the image capture device can be determined by a user or others. Therefore, the image capture device can control the first resolution of the first temporal motion data P 1  after the image capture device is set. 
         [0030]    Please refer to  FIG. 3 .  FIG. 3  is a circuit diagram of an embodiment of an image capture device according to the invention. 
         [0031]    The image capture device comprises a switch  301 , a control unit  302 , a driving circuit  303 , an image capture element  304 , an analog-to-digital (ADC) unit  305 , a memory unit  306 , a display unit  307  and a storage device  308 . 
         [0032]    The switch  301  starts and stops a plurality of mode operations of the image capture device. The switch  301 , which is a shutter button, sends instructions to execute different mode operations according to whether the shutter button is half-pressed or pressed down. 
         [0033]    The control unit  302  controls the operation, input signals and the determination of the elements shown in  FIG. 3 . The control unit  302  first starts by outputting signals to the driving circuit  303 , and finishes the image capture element  304  operations or controls the image capture element  304  to execute the mode-switching operation, wherein the control unit  302  is a digital signal processor (DSP) or a central processing unit (CPU). 
         [0034]    The driving circuit  303  drives the image capture element  304  and controls the operation of the image capture element  304  according to the input instruction. 
         [0035]    The image capture element  304  senses the light beam reflected by the object being photographed and outputs batches of analog motion image signals or analog still image signals according to the motion image output mode signal or the still motion image output mode signal from the control unit  302 . 
         [0036]    The ADC unit  305  converts the analog signals from the image capture element  30  into digital signals and transmits the digital signals to the control unit  302  for further processing. 
         [0037]    The memory unit  306  temporally stores data and the control unit  302  can rapidly read or write data to the memory unit  306 . 
         [0038]    The display unit  307  shows the preview image before the still image data is captured, and the motion image data or still image data is stored in the memory unit  306  or the storage unit  308 . Users can browse or view the image on the display unit  307 . 
         [0039]    When the image capture device is turned on, the image capture device enters into the standby mode. The control unit  302  sends a control signal to the driving circuit  303  to start the image capture element  304 . The image capture element  304  outputs image data under the motion image output mode and the display unit  307  displays the image data. If the switch  301  is pressed down, the start instruction is sent and the ADC unit  305  transforms the analog motion image data from the image capture element  304  into the digital motion image data. The digital motion image data is temporally stored in the storage device  308  and processed by the control unit  302 . After the control unit  302  processes the digital motion image data, the first motion image R 1  is generated and stored in the memory unit  36 . The control unit  302  controls the display unit  307  to display the first motion image R 1  stored in the memory unit  36  and users can browse or view the image on the display unit  307 . The first motion image R 1  is written to the storage unit  308 , wherein the resolution of the first motion image R 1  is the first resolution and the frame rate of the first motion image R 1  is n frames/second. 
         [0040]    When the first motion image is being captured REC 1 , the switch  301  is half-pressed to trigger the first instruction. When the control unit  302  receives the first instruction from the switch  301 , the control unit  302  stops writing the first motion image R 1  to the storage unit  308  and executes a preview operation PI 1 . During the preview operation PI 1 , a focus operation, a white balancing operation and an exposure operation to an object being photographed are executed. The control unit  302  generates and transmits a first temporal motion data P 1  to the display unit  307  for display. The control unit  302  processes the first temporal motion data P 1  to generate and store the preview image data with the first resolution. When the switch  301  is further pressed after being half-pressed, a second instruction is sent to the control unit  302 . The control unit  302  starts a time counting operation and outputs signals to the driving circuit  303  to switch the mode of the image capture element  304  to the still image output mode and the image capture element  304  outputs the first still image data S 1 . After the first still image data S 1  is completely output, the control unit  302  stops the time counting operation and sends an enable signal to the driving circuit  303  to switch the mode of the image capture element  304  from the still image output mode to the motion image output mode to output the second motion image data R 2 . The control unit  302  transforms the first still image data S 1  into a still image file and writes the still image file to the storage unit  308 . The control unit then calculates the value of P according to a predetermined algorism. The control unit  302  processes the first still image data S 1  to generate and store a second temporal motion data with the first resolution to the storage unit  308 , wherein the second temporal motion data comprises P frames. The control unit  302  combines the first motion image data R 1 , the preview image data and the second temporal motion data to generate and write the second motion data to the storage unit  308 , wherein the calculation of P is the product of the frame rate n of the first motion image data R 1  and the time counting operation of the control unit  302 . The number of P is the number of the frames of the motion image data during the capturing time of the first still image data S 1 . 
         [0041]    When the switch  301  is pressed down again, a finish instruction is sent to the control unit  302  and the control unit  302  stops writing the second motion image data R 2  to the storage unit  308  and the image capture devices return to the standby mode. 
         [0042]    Please refer to  FIG. 4 .  FIG. 4  is a flowchart of an embodiment of an image data processing method to capture still images while capturing motion images in accordance with the invention. 
         [0043]    The still image capture method during capturing the motion images operation comprises the following steps. 
         [0044]    Step (A): During the standby mode, when the shutter button is pressed down, the operation for capturing the motion images is started and a first motion image data with the first resolution is stored. 
         [0045]    Step (B): When the shutter button is half-pressed, the operation of the step (A) is stopped and a preview operation is executed, wherein the preview image data is transformed into the first motion image data with the first resolution. 
         [0046]    Step(C): When the shutter button is further pressed after being half-pressed, the image capture device captures the first still image data and after the first still image data is completely captured, the operation for capturing the motion images is started again. The first still image data is transformed into a still image file and a second temporal motion data with the first resolution. The second motion data is then generated by sequentially combining the first motion image data, the preview image data and the second temporal motion data. 
         [0047]    Step(D): When the shutter button is pressed down again, the operation for capturing the motion images is stopped and the image capture device returns to the standby mode. 
         [0048]    More specifically, the method further comprises the following steps. 
         [0049]    Step  1 : As shown in step S 101 . The image capture device is at a standby mode. 
         [0050]    Step  2 : As shown in step S 102 . It is determined whether the shutter button has been pressed. If the shutter button has been pressed, the step S 103  is executed and if the shutter button has not pressed, the method returns to the step S 101  and the image capture is at a standby mode. 
         [0051]    Step  3 : As shown in step S 103 . The image capture executes the operation of capturing the motion images and stores a first motion image data with a first resolution, wherein the frame rate of the first motion image data is n frames/second. 
         [0052]    Step  4 : As shown in step S 104 . When the motion images are being captured, the state of the shutter button is determined. If the state of the shutter button has not been changed, the step S 108  is executed. If the shutter button is half-pressed, the step S 105  is executed. If the shutter button has been further pressed, the step S 108  is executed. 
         [0053]    Step  5 : As shown in step S 105 . The image capture device enters to a still image capture mode and executes an image preview operation. During the step S 105 , the preview image data is transformed into an image preview data with the first resolution. 
         [0054]    Step  6 : As shown in step S 106 . During the image preview operation, the state of the shutter button is determined. If the shutter button is still half-pressed, the step S 105  is executed. If the shutter button is further pressed from the half-pressed state, the step S 107  is executed. 
         [0055]    Step  7 : The still image capture operation is executed and a time counting operation is executed. When the still image is completely captured, the time counting operation is stopped and a time period is acquired. The captured still images is compressed and stored in a still image file. The captured still images are transformed into a second temporal motion data with the first resolution according to the value of P which is calculated based on the value n in step  3  and the time period, wherein the second temporal motion data comprises P frames of the still image data. The second motion data is then generated by sequentially combining the first motion image data, the preview image data and the second temporal motion data. When the aforementioned operations in step  7  are completely executed, the image capture device executes the operation of capturing the motion images. 
         [0056]    Step  8 : As shown in step S 108 . Here, the image capture device stops the operation of capturing the motion images and returns to the standby mode. 
         [0057]    While the invention has been described by way of example and in terms of the preferred embodiments, it is to be understood that the invention is not limited to the disclosed embodiments. To the contrary, it is intended to cover various modifications and similar arrangements (as would be apparent to those skilled in the art). Therefore, the scope of the appended claims should be accorded the broadest interpretation so as to encompass all such modifications and similar arrangements.