Source: https://patents.google.com/patent/KR101342477B1/en
Timestamp: 2020-04-01 02:55:23
Document Index: 348077353

Matched Legal Cases: ['art 6', 'art 1', 'art 6', 'art 1', 'art 6', 'art 6', 'art 6', 'art 8', 'art 9', 'art 9', 'art 2', 'art 8', 'art 11', 'art 6', 'art 2', 'art 3', 'art 6', 'art 6', 'art 6', 'art 6', 'art 6', 'art 6', 'art 6', 'art 6', 'art 6', 'art 6', 'art 6', 'art 6', 'art 6', 'art 14']

KR101342477B1 - Imaging apparatus and imaging method for taking moving image - Google Patents
Imaging apparatus and imaging method for taking moving image Download PDF
KR101342477B1
KR101342477B1 KR1020120006879A KR20120006879A KR101342477B1 KR 101342477 B1 KR101342477 B1 KR 101342477B1 KR 1020120006879 A KR1020120006879 A KR 1020120006879A KR 20120006879 A KR20120006879 A KR 20120006879A KR 101342477 B1 KR101342477 B1 KR 101342477B1
KR1020120006879A
KR20120084696A (en
요시유키 가토
2011-01-20 Priority to JPJP-P-2011-009430 priority Critical
2011-01-20 Priority to JP2011009430A priority patent/JP5234119B2/en
2012-01-20 Application filed by 가시오게산키 가부시키가이샤 filed Critical 가시오게산키 가부시키가이샤
2012-07-30 Publication of KR20120084696A publication Critical patent/KR20120084696A/en
2013-12-17 Publication of KR101342477B1 publication Critical patent/KR101342477B1/en
As the imaging device 100, while recording the moving picture of the subject as one continuous moving picture data, the moving picture is controlled by the imaging condition adjusting unit 6c which adjusts the imaging condition of the subject according to the change in the state of the subject picked up by the imaging unit. During recording of the data, the frame rate at the time of recording the moving picture by the first recording frame rate setting section 6a for switching the frame rate at the time of recording the moving picture is higher than the first recording frame rate from the first recording frame rate. In the case of switching to the second recording frame rate, the imaging control section 6 is provided to limit the adjustment of the imaging conditions by the imaging condition adjusting section while recording at the second recording frame rate. In this way, moving picture data capable of appropriately confirming the state of the main subject is obtained.
Imaging apparatus which photographs video, and imaging processing method {IMAGING APPARATUS AND IMAGING METHOD FOR TAKING MOVING IMAGE}
The present invention relates to an image pickup apparatus capable of controlling the frame rate at the time of shooting a moving image, and an image pickup processing method.
Background Art Conventionally, an image pickup device capable of obtaining moving image data that can be reproduced in slow motion or high speed motion by changing the image capture frame rate in the middle of moving image capture is known (see, for example, Japanese Unexamined Patent Application Publication No. 2005-136754).
By the way, in general, during video shooting, the exposure and the white balance appropriate to the state of the subject are always maintained, and the imaging conditions are adjusted to follow the change of the subject state. Therefore, for example, even when the imaging frame rate is set to high speed for the purpose of reproducing and confirming a main subject with fast motion in slow motion, the imaging conditions such as exposure and white balance are adjusted to follow the state of the subject. When playback is performed, although it is possible to confirm the detailed operation of the main subject in slow motion, there is a problem that the brightness or color tone of the main subject cannot be properly checked.
There is a need for an image capturing apparatus and image capturing method capable of obtaining moving image data capable of appropriately confirming a state of a main subject.
One aspect of the invention,
An imaging device having an imaging section for imaging an object,
A moving picture recording unit for recording a moving picture of a subject sequentially picked up by the imaging unit as one continuous moving picture data;
An adjusting unit for adjusting imaging conditions of the subject in accordance with a change in the state of the subject imaged by the imaging unit during recording of one continuous moving image data by the moving image recording unit;
A switching unit for switching the frame rate when recording moving pictures during recording of one continuous moving picture data by the moving picture recording unit;
Recording at the second recording frame rate when the frame rate when the moving picture is recorded by the switching unit is switched from a first recording frame rate to a second recording frame rate that is faster than the first recording frame rate Adjustment control unit for restricting adjustment of imaging conditions by the adjustment unit
In addition, another aspect of the present invention,
An imaging processing method using an imaging device having an imaging unit,
A process of recording a moving picture of a subject sequentially picked up by the imaging unit as one continuous moving picture data;
A process of adjusting imaging conditions of the subject in accordance with a change in the state of the subject imaged by the imaging unit during recording of the one continuous video data;
A process of switching a frame rate at the time of recording a moving picture during recording of the one continuous moving picture data;
The imaging condition during recording at the second recording frame rate when the frame rate at the time of recording the moving picture is switched from the first recording frame rate to a second recording frame rate which is faster than the first recording frame rate. Treatment to limit the adjustment of
FIG. 2 is a flowchart showing an example of an operation relating to imaging processing by the imaging apparatus of FIG. 1.
FIG. 3 is a diagram for explaining the imaging process of FIG. 2.
4 is a block diagram showing a schematic configuration of an imaging device of Embodiment 2 to which the present invention is applied.
FIG. 5 is a flowchart showing an example of an operation relating to imaging processing by the imaging apparatus of FIG. 4.
FIG. 6 is a diagram for explaining the imaging process of FIG. 5.
Fig. 7 is a block diagram showing a schematic configuration of an imaging device of Embodiment 3 to which the present invention is applied.
FIG. 8 is a flowchart showing an example of an operation relating to imaging processing by the imaging apparatus of FIG. 7.
FIG. 9 is a diagram for explaining the imaging process of FIG. 8.
EMBODIMENT OF THE INVENTION Below, the Example of this invention is described concretely with reference to drawings. However, the scope of the invention is not limited to the illustrated example.
The imaging apparatus 100 of the first embodiment adjusts the imaging conditions of the subject in accordance with the change of the subject state to be imaged while recording the moving image of the subject as one continuous moving image data, and records the moving image during recording of the moving image data. When the frame rate at the time of recording is switched from the first recording frame rate to the second recording frame rate which is faster than the first recording frame rate, the adjustment of the imaging condition is restricted while recording at this second recording frame rate.
Specifically, as shown in FIG. 1, the imaging device 100 includes a lens unit 1, an electronic imaging unit 2, a unit circuit unit 3, an image generating unit 4, an object detecting unit 5, Imaging control unit 6, image processing unit 7, display control unit 8, display unit 9, recording medium control unit 10, operation input unit 11, buffer memory 12, program memory 13, central control unit (14) and the like.
In addition, the image generating unit 4, the subject detecting unit 5, the imaging control unit 6, the image processing unit 7, the display control unit 8, the recording medium control unit 10, the buffer memory 12, the program memory 13 The central control unit 14 is connected via a bus line 15.
Although not shown, the lens unit 1 has a zoom lens, a focus lens, an aperture, and the like, and forms an optical image of a subject passing through these lenses.
The electronic imaging unit 2 is disposed on the optical axis of the lens unit 1. The electronic imaging unit 2 is composed of an image sensor such as a charge coupled device (CCD) or a complementary metal-oxide semiconductor (CMOS), for example, and an optical image passing through various lenses of the lens unit 1. Is converted into two-dimensional image signals (RGB image data) at predetermined intervals corresponding to the image pickup frame rate, and output to the unit circuit unit 3.
The unit circuit section 3 may be omitted, for example, but includes a CDS (Correlated Double Sampling), AGC (Auto Gain Control) and ADC (Analog to Digital Converter). ) And the like. The unit circuit section 3 holds an analog image signal corresponding to the optical image of the subject which is output from the electronic image capturing unit 2 by the CDS at predetermined intervals corresponding to the recording frame rate, and holds the image signal in the AGC. After amplifying by using the amplified image signal, the amplified image signal is converted into a digital image signal by the ADC. The unit circuit unit 3 then transmits the digital image signal to the image generation unit 4.
In this way, the lens unit 1, the electronic imaging unit 2, and the unit circuit unit 3 constitute an imaging unit for imaging an object.
The image generating unit 4 generates the luminance signal Y and the color difference signal Cb and Cr (YUV data) of the digital value from the digital image signal transmitted from the unit circuit unit 3.
Specifically, the image generating unit 4 performs pixel interpolation processing and gamma with a color process circuit (not shown) on digital image data of each frame image f transmitted from the unit circuit unit 3 at predetermined intervals. After each of the color process processes including the correction process, the luminance signal Y and the color difference signals Cb and Cr (YUV data) of digital values are generated.
Here, in the frame rate when the imaging device 100 processes a process of imaging a moving picture and recording it as moving picture data, the imaging frame rate indicating the frame rate at which the electronic imaging unit 2 picks up the moving picture, and the imaging condition adjusting unit ( There is an adjustment frame rate indicating the frame rate at which 6c) adjusts the imaging condition, and a recording frame rate indicating the frame rate at which the image generating unit generates an image of each frame and records it on the recording medium M as moving image data. In this case, the adjustment frame rate and the recording frame rate are changed by fixing the imaging frame rate to a high frame rate such as 120 fps or 240 fps and removing the frame used for adjustment or the frame used for recording.
By performing such an operation, it is possible to easily and quickly switch between the adjustment frame rate and the recording frame rate without causing any deviation of the frame when switching the adjustment frame rate or the recording frame rate. However, instead of changing the adjustment frame rate or the recording frame rate by fixing the imaging frame rate, the adjustment frame rate or the recording frame rate may be changed without changing the frame by changing the imaging frame rate itself.
The recording frame rate includes a frame rate corresponding to normal video shooting and a frame rate corresponding to high speed video shooting than the normal video shooting. For example, the recording frame rate corresponding to normal video shooting is 30 fps, 60 fps or the like, and the recording frame rate corresponding to high speed video shooting is 120 fps, 240 fps or the like. However, the recording frame rate is not limited to these examples. It is possible.
The image generating unit 4 then outputs the image data of the generated luminance chrominance signal to the subject detecting unit 5, the imaging control unit 6, and the image processing unit 7.
The subject detecting unit 5 detects a specific subject from the image data of the luminance chrominance signal of each frame image f output from the image generating unit 4.
That is, the subject detection unit 5 acquires image data (YUV data) of each frame image f, and, for example, various image processing such as face detection processing, edge detection processing, feature extraction processing, etc. with respect to the image data. Is performed to detect an area (eg, a face area or the like) in which a specific subject is included. Specifically, the subject detection unit 5 extracts candidate regions that are candidates for a specific subject by various image processing such as face detection processing, edge detection processing, feature extraction processing, and the like, and among the extracted candidate regions. It is detected as a specific subject that satisfies the predetermined identification condition.
The predetermined identification condition is based on the size of, for example, a shape such as "human face" or "animal", or a size such as a ratio (for example, half or more) to the image of the whole view angle. And a hue such as whether the lightness or saturation is high and is a vivid (colorful) color tone or whether it is flesh color.
Since the face detection process, the edge detection process, and the feature extraction process are known technologies, detailed description thereof will be omitted here.
In this manner, the subject detecting unit 5 constitutes subject detecting means for detecting a specific subject from a moving image picked up by the lens unit 1, the electronic imaging unit 2, and the unit circuit unit 3 as the imaging unit.
The imaging control unit 6 controls operations of the lens unit 1, the electronic imaging unit 2, the unit circuit unit 3, and the like.
That is, the imaging control part 6 is equipped with the drive source, such as a motor, the driver which drives this drive source, etc. (not shown either), for example, and the zoom lens and the focus lens of the lens part 1 are carried out. Drive in the optical axis direction. Moreover, the imaging control part 6 is equipped with the drive part (not shown) which performs the diameter expansion and reduction of the aperture of the lens part 1, for example, and the exposure adjusted by the imaging condition adjustment part 6c (after-mentioned). Depending on the adjustment conditions, the diameter of the aperture is reduced or reduced.
In addition, the imaging control unit 6 includes, for example, a timing generator (TG), a driver for driving the electronic imaging unit 2 (both not shown), and an imaging frame rate or an imaging condition adjusting unit ( The operation timing of the electronic imaging unit 2 is controlled through the TG and the driver in accordance with the imaging conditions (for example, exposure time, etc.) adjusted by 6c). The imaging control section 6 also controls the operation timing of the unit circuit section 3 in accordance with the recording frame rate.
That is, the imaging control unit 6 operates the electronic imaging unit 2 at a predetermined timing according to an imaging frame rate or an imaging condition (for example, exposure time, etc.) to convert the optical image of the subject into an analog image signal. The unit circuit unit 3 is operated at a predetermined timing according to a predetermined recording frame rate (for example, a first recording frame rate corresponding to normal moving picture shooting), and is output from the electronic imaging unit 2 and input. The analog image signal corresponding to the optical image of the subject to be converted is converted into a digital image signal (frame image f). In other words, the imaging control unit 6 controls the electronic imaging unit 2 and the unit circuit unit 3 to control the plurality of frame images f,... A moving picture of a subject is picked up at intervals corresponding to the first recording frame rate.
At this time, when an instruction to switch the recording frame rate is input in accordance with a predetermined operation of the operation input unit 11 by the user, the imaging control unit 6 switches and is set by the first recording frame rate setting unit 6a (described later). For every predetermined period according to a recording frame rate (e.g., a second recording frame rate corresponding to high-speed video recording, etc.), an analog image signal corresponding to the optical image of the subject output from the electronic imaging unit 2 and inputted is output. The unit circuit section 3 converts the digital image signal (frame image f).
In addition, the imaging control unit 6 includes a first recording frame rate setting unit 6a, a state detection unit 6b, and an imaging condition adjustment unit 6c.
The first recording frame rate setting section 6a sets the recording frame rate.
That is, the first recording frame rate setting unit 6a sets the recording frame rate related to the drive cycle of the unit circuit unit 3 in accordance with the predetermined operation of the operation input unit 11 by the user. Specifically, among the recording frame rates corresponding to each of normal moving picture shooting and high speed moving picture shooting, a setting signal of a recording frame rate designated by a user of the selection determination button 11b of the operation input unit 11 by the user is selected. Output to the central control unit 14. The central control unit 14 outputs the setting signal output from the operation input unit 11 to the imaging control unit 6, and the first recording frame rate setting unit 6a of the imaging control unit 6 inputs the input setting. The recording frame rate is set according to the signal. In other words, during the recording of one continuous moving picture data, the selection determination button 11b is operated by the user for predetermined operation, whereby the first recording frame rate setting section 6a records the recording frame rate corresponding to normal moving picture shooting. It is set by switching to the frame rate and the recording frame rate corresponding to high speed video shooting.
Thus, the imaging frame rate setting part 6a comprises the switching means which switches the frame rate at the time of recording a moving picture, while recording the moving picture data of a subject.
As the state detection unit, the state detection unit 6b includes a plurality of frame images f,... Constituting a moving image generated by imaging of a subject. Based on this, the state of the subject is detected. That is, the state detection unit 6b detects the brightness or color tone of each frame image f based on the image data (YUV data) of the luminance chrominance signal of each frame image f output from the image generation unit 4.
Specifically, for example, when detecting the brightness of the frame image f, the state detection unit 6b includes a predetermined metering method (e.g., a center weighted metering method, a spot metering method, an average metering method, and a plurality of minutes). ), The brightness of the frame image f is detected based on the luminance signal Y of each frame image f). In addition, for example, when detecting the color tone of the frame image f, the state detector 6b converts the YUV data of each frame image f into image data of the HSV color space, and then saturation S and brightness. Gray pixel estimation conditions are calculated from the histogram of V according to the color temperature of the light source (for example, sunlight, fluorescent light, clear sky, cloudy sky, etc.). The state detector 6b then estimates the gray component included in each frame image f in accordance with the gray pixel estimation condition.
At this time, the state detection unit 6b detects the brightness or color tone of each frame image f on the basis of a specific subject (for example, a human face area, etc.) detected by the subject detection unit 5 from each frame image f. May be performed.
The center weighted light metering method is a light metering method which focuses on the center portion of the frame image f, and the spot metering method is a light metering method which is limited to a predetermined area of the frame image f, and the average metering method is the entire frame image f. The photometric method is a photometric method in which light is measured on the surface and its average value is obtained.
The imaging condition adjusting unit 6c adjusts the imaging conditions of the subject set by the imaging control unit 6 in accordance with the change in the state of the subject being imaged as the adjusting means. That is, the imaging condition adjusting unit 6c uses the imaging control unit 6 for automatic exposure adjustment processing (AE) or automatic white balance adjustment processing, for example, on the basis of the subject state detected by the state detection unit 6b. Adjust the exposure adjustment conditions or white balance adjustment conditions for (AWB).
Specifically, for example, when adjusting the exposure adjustment conditions relating to the automatic exposure adjustment process (AE), the imaging condition adjustment unit 6c uses the brightness of the subject detected by the state detection unit 6b as a reference. Based on the predetermined program diagram, the aperture value of the aperture of the lens unit 1, the shutter speed of the electronic imaging unit 2, the signal amplification factor (ISO sensitivity) of the AGC of the unit circuit, and the like are adjusted. In addition, for example, when adjusting the white balance adjustment condition concerning the automatic white balance adjustment process (AWB), the imaging condition adjustment unit 6c is configured to adjust the color (hue) of the gray component of the subject detected by the state detection unit 6b. ), The gain amount of each color component of RGB of each pixel of the frame image f is adjusted.
Here, the imaging condition adjustment unit 6c adjusts at least one of the exposure adjustment condition and the white balance adjustment condition on the basis of the specific subject (for example, the human face area, etc.) detected by the subject detection unit 5. You may also That is, the imaging condition adjustment unit 6c may adjust the exposure adjustment condition on the basis of, for example, the brightness of the face region of the person detected by the subject detection unit 5, or white on the basis of the color tone of the face region. You may adjust a balance adjustment condition.
Thus, the imaging condition adjustment part 6c comprises the adjustment means which adjusts the imaging conditions of the said subject according to the change of the subject state, during the recording of the moving image data of the subject.
The imaging control unit 6 also restricts the adjustment of the imaging conditions by the imaging condition adjusting unit 6c in accordance with the recording frame rate. Specifically, the image capturing control unit 6 is configured to capture an image capturing condition at a recording frame rate (first recording frame rate) corresponding to normal motion picture capturing so as to follow the image capturing condition of the subject to a change in the subject state ( 6c) to adjust sequentially. That is, the imaging control unit 6 adjusts the exposure by the imaging condition adjusting unit 6c with respect to each frame image f (for example, the frame image f1, etc.) picked up at a period corresponding to the recording frame rate corresponding to normal video shooting. The imaging conditions of the subject, such as conditions and white balance adjustment conditions, are sequentially adjusted to follow the change of the subject state.
In addition, the imaging control unit 6 can switch from a recording frame rate (first recording frame rate) in which the recording frame rate corresponds to normal video shooting to a recording frame rate (second recording frame rate) corresponding to high speed video shooting. If so, the adjustment by the imaging condition adjusting unit 6c is restricted so as to maintain the predetermined imaging condition adjusted before the recording frame rate is switched. That is, while recording a moving picture at a recording frame rate (first recording frame rate) corresponding to normal moving picture shooting, it is recorded by the first recording frame rate setting unit 6a in accordance with a predetermined operation of the operation input unit 11 by the user. If the frame rate can be switched to a recording frame rate (second recording frame rate) corresponding to high speed video shooting, the imaging control unit 6 according to the recording frame rate corresponding to normal video shooting before the recording frame rate is switched. The imaging conditions of the subject such as the exposure adjustment condition and the white balance adjustment condition adjusted by the imaging condition adjusting unit 6c are maintained with respect to the frame image f captured at intervals.
In this manner, the imaging control unit 6 determines that the frame rate when the moving picture is recorded by the first recording frame rate setting unit 6a is the first recording frame rate (for example, the recording frame rate corresponding to normal moving picture shooting). ), When switching to a second recording frame rate that is faster than the first recording frame rate (for example, a recording frame rate corresponding to high-speed video shooting), the imaging condition adjusting unit ( The adjustment control means which limits adjustment of the imaging condition by 6c) is comprised.
In addition, while the image capturing control unit 6 is recording a moving picture at a recording frame rate (second recording frame rate) corresponding to high speed moving picture shooting, the recording frame rate is a normal moving picture in accordance with a predetermined operation of the operation input unit 11 by the user. If it is possible to switch to a recording frame rate (first recording frame rate) corresponding to shooting, for each frame image f (for example, frame image f3, etc.) picked up at the recording frame rate corresponding to normal video shooting, The adjustment by the imaging condition adjusting unit 6c may be limited so that the recording state of the subject changes smoothly as compared with before the switching of the frame rate.
That is, during recording of the moving picture at the recording frame rate corresponding to high speed moving picture shooting, since the imaging condition of the subject is maintained at the predetermined imaging condition, the frame image photographed immediately after switching to the recording frame rate corresponding to the normal moving picture shooting. When f is sequentially adjusted so as to immediately follow the imaging condition of the subject to the change in the subject state, the recording state of the subject changes abruptly. Therefore, the imaging control unit 6 does not adjust the imaging conditions of the subject such as the exposure adjustment condition or the white balance adjustment condition by the imaging condition adjustment unit 6c so as to immediately follow the change of the subject state. For a while after switching to the recording frame rate, the imaging condition of the subject is adjusted by the imaging condition adjusting unit 6c so that the recording state of the subject changes smoothly.
Thereby, while recording a moving picture at a recording frame rate corresponding to high speed moving picture shooting, even if the recording frame rate is switched to the recording frame rate corresponding to normal moving picture shooting, it is possible to prevent the recording state of the subject from suddenly changing.
The image processing unit 7 compresses and encodes the image data (YUV data) generated by the image generating unit 4 by a predetermined coding method (for example, the Motion-JPEG method or the like) (not shown). And a decoding unit (not shown) for decoding the encoded image data read out from the recording medium control unit 10 by a decoding method corresponding to the coding method.
The display control part 8 performs control which reads the image data of the display signboard temporarily stored in the buffer memory 12, and makes it display on the display part 9. As shown in FIG.
Specifically, the display control unit 8 includes a VRAM (Video Random Access Memory), a VRAM controller, a digital video encoder, and the like. The digital video encoder is configured to read a plurality of frame images f,... Constituting a moving image stored in a VRAM (not shown) read out from the buffer memory 12. The luminance signals Y and the color difference signals Cb and Cr are read out from the VRAM at a predetermined reproduction frame rate via the VRAM controller, and a video signal is generated based on these data and output to the display unit 9.
Here, the predetermined reproduction frame rate is the same frame rate as the recording frame rate at the time of recording the moving picture data, and the display unit 9 as the reproducing means is, for example, a recording frame rate of 30 fps corresponding to normal moving picture shooting. If the playback of moving picture data recorded at is performed at 30 fps, a reproduction frame rate is performed. If the moving picture data recorded at a 60 fps recording frame rate is reproduced, a reproduction is performed at a 60 fps reproduction frame rate. In this way, any playback frame rate can be played back at the same speed as in real time, but a higher frame rate number (for example, 60 fps) can be played back more smoothly (with less flickering video).
As described below, in the case of moving picture data whose recording frame rate is switched in the middle, the recording frame rate set at the start of recording is added as a recording frame rate attribute of the moving picture data.
When the moving picture data is reproduced, the recording frame rate added as the recording frame rate attribute is read at the start of reproduction, and from the start of reproduction until the end of reproduction, the reproduction is fixed at this read frame rate and continues reproduction. do.
As described above, when playback is performed at a fixed playback frame rate, the playback speed at which a video is viewed varies depending on the change in the recording frame rate of the input video data. For example, the display control unit 8 includes a plurality of frame images f,... Captured at a period corresponding to a recording frame rate (for example, 30 fps) corresponding to normal video shooting. When the video data consisting of the video data is reproduced at a predetermined reproduction frame rate (e.g., 30 fps), it becomes a normal reproduction speed at which the imaging interval and reproduction interval of each frame image f coincide. In addition, for example, the display control unit 8 switches a plurality of frame images f,... Image captured at a cycle corresponding to a recording frame rate (for example, 240 fps) corresponding to high-speed moving picture shooting. When the moving picture data consisting of the video data is reproduced at a predetermined reproduction frame rate (e.g., 30 fps), the imaging interval of each frame image f is shorter than the reproduction interval and the reproduction speed of the slow motion is apparent. That is, the display control unit 8 matches the entirety of the moving image data with the first recording frame rate without changing the frame rate at the time of reproduction of the portions recorded at the first recording frame rate and the portions recorded at the second recording frame rate. By continuously playing back at the same frame rate, the portion recorded at the second recording frame rate is automatically played back in slow motion.
In this way, the display control unit 8 displays the moving picture data recorded in the form in which the frame rate (for example, 240 fps) at the time of recording is temporarily switched by the first recording frame rate setting unit 6a. In the case of playback display on the screen, the frame rate at the time of reproduction at the time of reproducing the portion where the frame rate at the time of recording is temporarily changed is different from the frame rate at the time of recording (for example, 240 fps) (for example, And playback control means for playback at 30 fps).
In Example 1, the frame rate at the time of reproduction is fixed so that the part can be automatically slow-motion reproduced at the time of reproduction of the moving picture data recorded in a form in which the frame rate at the time of recording is partially switched. It is also possible to select a reproduction method of reproduction while changing the frame rate at the time of reproduction in correspondence with the change of the frame rate so as to correspond in real time. In this case, instead of partially slow motion reproduction, it is possible to perform partially smooth reproduction.
In addition, these two playback methods may be selected by the user arbitrarily by selecting the playback mode.
The display part 9 is a liquid crystal display panel, for example, and displays the image etc. which were imaged by the electronic imaging part 2 based on the video signal from the display control part 8 on a display screen. Specifically, the display unit 9 includes a plurality of frame images f,... Generated by the imaging of the subject by the electronic imaging unit 2 and the imaging control unit 6 in the still image imaging mode or the moving image imaging mode. The live view image is displayed while sequentially updating at a predetermined frame rate. The display unit 9 also includes a plurality of frame images f,... Is displayed or an image (rec view image) recorded as a still image is displayed.
The recording medium control unit 10 is configured so that the recording medium M is detachably attached, and controls the reading of data from the attached recording medium M and the recording of data to the recording medium M. FIG.
Specifically, the recording medium control unit 10 stores image data for recording encoded by a coding unit (not shown) of the image processing unit 7 in a predetermined compression format (for example, Motion-JPEG format or the like). That is, a moving picture of a subject composed of a plurality of frame images sequentially picked up by the lens unit 1, the electronic imaging unit 2, and the unit circuit unit 3 is recorded as one continuous moving picture data (video recording means). Record in M.
The recording medium M is constituted of, for example, a nonvolatile memory (flash memory) or the like. However, the recording medium M is not limited thereto and can be arbitrarily changed as an example.
The operation input unit 11 is for performing a predetermined operation of the imaging device 100. Specifically, the operation input unit 11 is a shutter button 11a that can be pressed halfway and fully pressed in association with a shooting instruction of a subject, a selection determination button 11b related to a selection instruction such as an imaging mode or a function, A zoom button (not shown) for instructing the zoom amount adjustment is provided, and a predetermined operation signal is output to the central control unit 14 in accordance with the operation of these buttons.
The buffer memory 12 is a buffer for temporarily storing image data and the like, and is also used as a working memory and the like of the central control unit 14.
The program memory 13 stores various programs and data relating to the functions of the imaging device 100.
The central control unit 14 controls each unit of the imaging device 100. Specifically, the central control unit 14 includes a CPU (not shown) that controls each unit of the imaging device 100, and performs various control operations in accordance with various processing programs (not shown).
Next, the imaging process by the imaging device 100 is demonstrated with reference to FIG. 2 and FIG.
2 is a flowchart showing an example of an operation relating to an imaging process. 3 is a figure for demonstrating an imaging process.
And the following imaging process is performed when the imaging mode of a moving image is selected from the several imaging modes according to the predetermined operation of the selection determination button 11b of the operation input part 11 by a user. The imaging process is started when an imaging instruction of a moving image is input, and the processing of each step is repeatedly executed until an instruction to end imaging of the moving image is input.
As shown in FIG. 2, first, the imaging control unit 6 drives the electronic imaging unit 2 at a predetermined imaging frame rate (for example, 240 fps or the like) to form an image formed by the lens unit 1. The frame image f is taken in by converting the optical image into a two-dimensional image signal (RGB image data) (step S1).
Next, the imaging control section 6 branches the processing in accordance with the recording frame rate (step S2). Specifically, when the recording frame rate is the recording frame rate (for example, 30 fps or the like) corresponding to normal video shooting (step S2; normal video shooting frame rate), the processing step S3. On the other hand, if the recording frame rate is a recording frame rate (e.g., 240 fps or the like) corresponding to high speed moving image shooting (step S2; high speed moving image shooting frame rate), the process proceeds to step S8.
<Normal video photography frame rate>
In step S2, when the recording frame rate (for example, 30 fps or the like) corresponding to normal moving picture shooting (step S2; normal moving picture shooting frame rate), the imaging control unit 6 records the recording frame rate of the normal moving picture shooting. Frame image f (e.g., frame image f1, etc .; see FIG. 3) to be processed is subtracted from the frame image f continuously taken at a predetermined imaging frame rate (e.g., 240 fps). In the case of this example, it is specified by selecting one in eight ratios (step S3). That is, the skipped frame image f is skipped without executing the processing from step S4 to step S7 below, and the processing from step S4 to step S7 below for the frame image f that is not taken out (selected as the processing target). Run By performing this thinning process, the imaging control part 6 digitally outputs the analog image signal output from the electronic imaging part 2 by the unit circuit part 3 every predetermined period according to the recording frame rate of normal moving picture photography. Is converted into an image signal. The image generating unit 4 generates the luminance signal Y and the color difference signal Cb and Cr (YUV data) of the digital value from the digital image signal relating to the frame image f to be processed, which is transmitted from the unit circuit unit 3. .
Subsequently, the imaging control unit 6 state detection unit 6b outputs the subject state based on the image data (YUV data) of the luminance chrominance signal of the frame image f to be processed and input from the image generation unit 4. It detects (step S4). Specifically, the state detection unit 6b detects the brightness of the frame image f to be processed in the automatic exposure adjustment process (AE) by the imaging control unit 6 in accordance with a predetermined metering method, or performs automatic white balance adjustment. The color tone (gray component) of the frame image f to be used in the processing AWB is detected according to the gray pixel estimation condition according to the color temperature of a predetermined light source (for example, sunlight).
Next, the subject detecting unit 5 performs face detection processing, edge detection processing, and feature extraction processing on the image data (YUV data) of each frame image f input and input from the image generating unit 4. Various image processing such as and the like is performed to detect a region (for example, a face region or the like) in which a specific subject is included (step S5).
The detection of the state of the subject in step S4 may be performed based on a specific subject (for example, a face region or the like) detected from the frame image f stored before the frame image f of the processing target.
In addition, the detection process of the state of the subject of step S4 and the detection process of the specific subject of step S5 may reverse a process order, and in this case, it is based on the specific subject detected from the frame image f of one process target. You may detect the brightness, color tone, etc. of the frame image f of said one process target.
Next, the imaging condition adjustment unit 6c of the imaging control unit 6 adjusts the imaging conditions of the subject set by the imaging control unit 6 based on the subject state detected by the state detection unit 6b. The contents of the imaging conditions stored in the predetermined storage area are updated (step S6). Specifically, the imaging condition adjusting unit 6c uses the imaging control unit 6 for automatic exposure adjustment processing (AE) and automatic white balance adjustment processing (AWB) based on the subject state detected by the state detection unit 6b. Adjust the exposure adjustment conditions or white balance adjustment conditions for. And the imaging condition adjustment part 6c updates the content of the imaging condition stored in the predetermined | prescribed storage area | region under the exposure adjustment condition and white balance adjustment condition after adjustment.
Thus, the frame image f stored after the frame image f to be processed becomes a frame image f captured in a state where the imaging condition after the update is reflected.
Next, the central control unit 14 stores the frame image f of the processing target generated by the image generating unit 4 as the recording frame image f, and stores the YUV data of the frame image f in the buffer memory 12. (Step S7). That is, in the case of the normal moving picture photographing frame rate, the frame image f selected at one ratio out of eight of the frame images f continuously taken in at 240 fps is stored in the buffer memory 12 at a recording frame rate of 30 fps.
<High speed video photography frame rate>
On the other hand, in the case where the recording frame rate (for example, 240 fps or the like) corresponding to the high speed video recording is performed in step S2 (step S2; high speed video recording frame rate), the imaging control unit 6 indicates that the recording frame is the high speed video. The image capturing condition adjusting section 6c adjusts the image capturing condition 6c so as to maintain a predetermined image capturing condition before switching to the recording frame rate corresponding to photographing (step S8). Specifically, the imaging control unit 6 is an imaging condition adjusting unit for the frame image f captured at a period corresponding to the recording frame rate corresponding to normal video shooting before the recording frame rate is switched to the recording frame rate corresponding to high speed video shooting. The image pickup conditions of the subject, such as exposure adjustment conditions and white balance adjustment conditions, which are sequentially adjusted by (6c) and stored in the predetermined storage area, are maintained.
Thereafter, the central control unit 14 shifts the processing to step S7, and the frame image f (for example, The frame image f2, etc .; see FIG. 3) is stored as the recording frame image f in the buffer memory 12 (YUV data of the frame image f) (step S7). That is, in the case of the high speed moving image photographing frame rate, the frame image f continuously taken in at 240 fps is not removed, and is stored in the buffer memory 12 at the recording frame rate of 240 fps as it is.
Each process described above is repeatedly executed until an instruction to end imaging of a moving image is input.
When an instruction to end the imaging of the moving picture is input, the recording medium control unit 10 controls the recording frame rate (30 fps in this example) set for the moving picture data stored in the buffer memory 12 at the start of recording of the moving picture data. ) Is added as a recording frame rate attribute and stored in the recording medium M.
As described above, according to the image capturing apparatus 100 of the first embodiment, the exposure and the white balance appropriate to the state of the subject are always maintained throughout the moving image photographing, and the image capturing is performed while adjusting the imaging condition to follow the change of the subject state. When recording is performed, and during the moving picture shooting, when partly switching to a higher frame rate (second recording frame rate) than the normal frame rate (first recording frame rate), shooting recording is performed so as to limit the change in the imaging condition. Record video data. Therefore, when the entire video data is played back at a constant playback speed, the entire video recording can always see the image adjusted to the appropriate exposure or white balance according to the subject's situation, and the user can control the deterministic moment or the like. It is possible to check the detailed operation of the main subject automatically by automatically slow motion reproduction without the need, and to check the brightness and color tone of the main subject during this slow motion reproduction as well.
That is, the main subject is changed by changing the background irrespective of the state of the main subject, for example, when photographing while the imaging apparatus 100 is panned by a metering method that considers the brightness of the entire frame image f. The brightness or color tone of the main subject can be prevented from being changed, and then, when the video is played back at a predetermined playback frame rate, the brightness or color tone of the main subject can be appropriately checked. In addition, since the imaging condition of the subject is not changed according to the degree of reflection of light that is changed by the rotation of the main subject, such as when photographing a main subject rotating by using a metering method based on the brightness of the main subject, Thereafter, when the moving image is reproduced at a predetermined reproduction frame rate, the degree of reflection of light of the main subject can be appropriately checked.
In the first embodiment, when the recording frame rate is switched to the recording frame rate corresponding to the high speed video shooting, the detection processing of the state of the subject (step S4) or the detection processing of the specific subject (step S5) is not performed. However, the present invention is not limited to this, and the detection process of the subject state or the detection process of the specific subject may be performed without reflecting the imaging condition. In this case, for example, a plurality of frame images f,... Constituting a moving picture. In the meantime, the frame image f may be specified as a processing target at predetermined intervals considering the time required for the detection process of the state of the subject or the execution of the detection process of the specific subject.
In addition, when the recording frame rate is switched to the recording frame rate corresponding to high-speed moving picture shooting, the predetermined imaging condition before the switching of the frame rate is maintained, but the present invention is not limited thereto, and the imaging condition of the subject is recorded. You may make it adjust with the imaging condition adjustment part 6c so that may change gently.
That is, for example, a plurality of frame images f,... Constituting a moving picture. Among them, the image pickup condition adjusting unit (1) performs a detection process of a state of a subject or a detection process of a specific subject by using a frame image f captured at predetermined intervals longer than an interval according to a recording frame rate corresponding to high-speed video shooting. 6c) is based on a subject state detected by the state detector 6b at predetermined intervals or a specific subject detected by the subject detector 5 (for example, a face area of a person). Adjust the imaging conditions for the subject, such as the exposure adjustment conditions and the white balance adjustment conditions. At this time, the imaging control unit 6 does not adjust the imaging condition of the subject such as the exposure adjustment condition or the white balance adjustment condition to follow the change of the subject state by the imaging condition adjusting unit 6c, but instead of adjusting the imaging condition of the subject to the subject. The imaging condition adjusting unit 6c adjusts the recording state of the recording mode. Specifically, for example, the imaging control unit 6 detects the at least one frame image f between the two frame images f, f photographed with a predetermined gap, and the subject detected from the previous frame image f. Imaging conditions so as to gradually change from the imaging conditions adjusted by the imaging condition adjusting unit 6c to the imaging conditions adjusted by the imaging condition adjusting unit 6c in correspondence with the state of the subject detected from a later frame image f in response to the state of. Adjust In addition, for example, the imaging control part 6 has the imaging conditions adjusted by the imaging condition adjustment part 6c with respect to two frame images f and f picked up with the predetermined | prescribed gap based on the following frame image f, In the case where the imaging condition that is adjusted by the imaging condition adjustment unit 6c is greatly changed by more than a predetermined ratio based on the previous frame image f, the imaging adjusted by the imaging condition adjustment unit 6c based on the subsequent frame image f. It is controlled so that the change of the condition becomes smaller by a predetermined ratio.
As a result, the recording state of the moving picture recorded at the recording frame rate corresponding to the high speed moving picture shooting can be prevented from being changed suddenly, and the state of the main subject can be appropriately confirmed.
4 is a block diagram showing a schematic configuration of an imaging device 200 of Embodiment 2 to which the present invention is applied.
In addition, since the imaging device 200 of Example 2 has substantially the same structure as the imaging device 100 of Example 1 except for being detailed below, detailed description is abbreviate | omitted.
The image capturing apparatus 200 according to the second embodiment is configured to, when recording a moving image at a recording frame rate corresponding to high speed moving image shooting, when the size of an operation for changing the shooting direction occurring in the main body of the apparatus is larger than a predetermined value. The imaging condition is adjusted so that the recording state of the subject in the moving picture is smoothly changed.
Specifically, as shown in FIG. 4, the imaging device 200 includes the lens unit 1, the electronic imaging unit 2, the unit circuit unit 3, the image generating unit 4, the state detection unit 6b, Imaging control unit 6, image processing unit 7, display control unit 8, display unit 9, recording medium control unit 10, operation input unit 11, buffer memory 12, program memory 13, central control unit In addition to 14, a motion detection unit 16 is provided.
The motion detector 16 detects the magnitude of the motion occurring in the main body of the imaging device 200 as the motion detection means.
That is, the motion detection unit 16 includes, for example, a motion detection sensor (not shown) such as an acceleration detection sensor or an angular velocity detection sensor, and based on an output signal from the motion detection sensor, Operation information, such as the magnitude | size of the motion (swing) which changes the shooting direction which arises, is specified.
The motion detection unit 16 may detect the speed of the motion instead of the magnitude of the motion based on the output signal from the motion detection sensor.
The image capturing control unit 6 controls the size of an operation occurring in the apparatus main body detected by the motion detector 16 when recording a video at a recording frame rate (for example, 240 fps or the like) corresponding to high speed video recording. It is determined whether it is greater than a predetermined threshold. Here, when it is determined that the magnitude of the operation occurring in the apparatus main body is larger than a predetermined threshold value, the imaging control unit 6 state detection unit 6b performs a plurality of frame images f,... The frame image f (e.g., frame image f2, etc .; captured in FIG. 6) captured at predetermined intervals longer than the interval (e.g., 1/240 seconds, etc.) corresponding to the recording frame rate corresponding to the high speed video recording. As the processing target, detection processing of the state of the subject is performed.
At this time, the subject detecting unit 5 may perform the process of detecting a specific subject by targeting the frame image f captured at every predetermined interval longer than the interval according to the recording frame rate corresponding to high-speed video shooting.
In addition, the imaging control unit 6, when recording a moving picture at a recording frame rate corresponding to high-speed moving picture shooting, the magnitude of the operation occurring in the apparatus main body detected by the motion detection unit 16 is larger than a predetermined threshold value. If it is determined that the image pickup conditions of the subject are not adjusted to follow the change in the state of the subject, for each frame image f photographed with a predetermined interval longer than the interval according to the recording frame rate corresponding to the high speed video shooting, the imaging conditions of the subject are not adjusted. Is adjusted by the imaging condition adjusting unit 6c so that the recording state of the subject in the moving picture is smoothly changed.
In other words, the imaging condition adjusting unit 6c of the imaging control unit 6 determines by the state detecting unit 6b the respective frame images f captured at predetermined intervals longer than the interval according to the recording frame rate corresponding to high-speed video shooting. The imaging conditions of the subject, such as the exposure adjustment condition and the white balance adjustment condition, are adjusted based on the detected subject state for each interval. At this time, the imaging control unit 6 captures images of the at least one frame image f between the two frame images f and f captured with a predetermined gap corresponding to the state of the subject detected from the previous frame image f. The imaging conditions are adjusted so as to gradually change from the imaging conditions adjusted by the condition adjusting unit 6c to the imaging conditions adjusted by the imaging condition adjusting unit 6c in correspondence with the state of the subject detected from the frame image f later.
The imaging control unit 6 is configured such that the imaging conditions adjusted by the imaging condition adjusting unit 6c based on the frame image f later, for the two frame images f and f captured with a predetermined gap, for example. In the case of a large change of more than a predetermined ratio with respect to the imaging condition adjusted by the imaging condition adjusting unit 6c on the basis of the frame image f, the imaging condition adjusted by the imaging condition adjusting unit 6c based on the subsequent frame image f. The change may be controlled so that the predetermined ratio becomes smaller.
Next, the imaging process by the imaging device 200 is demonstrated with reference to FIG. 5 and FIG.
5 is a flowchart showing an example of an operation relating to an imaging process. 6 is a figure for demonstrating an imaging process.
In addition, since the image pick-up process of the following Example 2 is substantially the same as the image pick-up process of the said Example 1 except having performed the determination process of the magnitude | size of the operation | movement which arises in an apparatus main body, the detailed description is abbreviate | omitted.
As shown in FIG. 5, first, the imaging control unit 6 drives the electronic imaging unit 2 at a predetermined imaging frame rate (for example, 240 fps or the like), similarly to the imaging process of the first embodiment. The frame image f is taken in by converting the optical image of the subject formed by the lens unit 1 into a two-dimensional image signal (RGB image data) (step S1).
Next, the imaging control section 6 branches the processing in accordance with the recording frame rate as in the imaging processing of the first embodiment (step S2).
In step S2, when the recording frame rate (e.g., 30 fps or the like) corresponding to normal moving picture shooting (step S2; normal moving picture shooting frame rate), similar to the image pickup processing of the first embodiment, steps S3 to S7 The process is performed.
That is, the imaging control unit 6 selects a frame image f (for example, a frame image f1, etc .; see FIG. 6) to be processed according to the recording frame rate of the above-mentioned normal moving image photographing. For example, it extracts from the frame image f taken in continuously at 240 fps etc. (in this case, it selects by one ratio to eight), and specifies it (step S3). Subsequently, the imaging control unit 6 state detection unit 6b outputs the subject state based on the image data (YUV data) of the luminance chrominance signal of the frame image f to be processed and input from the image generation unit 4. It detects (step S4). Next, the subject detecting unit 5 performs various image processing on the image data (YUV data) of each frame image f input and output from the image generating unit 4 at predetermined intervals in accordance with the recording frame rate of normal moving picture shooting. Is performed to detect a region (for example, a face region, etc.) containing a specific subject (step S5).
Subsequently, the imaging condition adjustment unit 6c of the imaging control unit 6 adjusts the imaging conditions of the subject set by the imaging control unit 6 based on the subject state detected by the state detection unit 6b. The contents of the imaging conditions stored in the predetermined storage area are updated (step S6).
Next, the central control unit 14 uses the frame image f as the recording frame image f as the recording frame image f, which is generated by the image generating unit 4 every predetermined period according to the recording frame rate of normal moving picture photographing. The YUV data of f is stored in the buffer memory 12 (step S7).
On the other hand, in step S2, when the recording frame rate (for example, 240 fps or the like) corresponding to high speed video shooting (step S2; high speed video shooting frame rate), the imaging control unit 6 sends the motion detection unit 16 to the motion detection unit 16. It is judged whether the magnitude | size of the operation | movement which arises in the said apparatus main body detected by this is larger than a predetermined threshold value (step S21). That is, the imaging control unit 6 fixes, for example, whether an operation larger than a predetermined threshold occurs in the main body of the apparatus, or is fixed in a predetermined state, for example, by a fun operation in a predetermined direction of the main body of the imaging apparatus 100. Determine if it is.
If it is determined in step S21 that the magnitude of the operation occurring in the apparatus main body is not larger than a predetermined threshold value (step S21; NO), similarly to the imaging process of the first embodiment, the imaging control unit 6 performs a recording frame. The image capturing condition adjusting section 6c adjusts the image capturing condition so as to maintain a predetermined image capturing condition before the rate is switched to the recording frame rate corresponding to the high speed video recording (step S8).
Thereafter, the central control unit 14 shifts the process to step S7 to record the frame image f generated by the image generating unit 4 at a predetermined period in accordance with a recording frame rate corresponding to high-speed moving picture shooting and recording frame. As the image f, the YUV data of the frame image f is stored in the buffer memory 12 (step S7).
On the other hand, when it is determined by step S21 that the magnitude | size of the operation | movement which arises in the said apparatus main body is larger than a predetermined threshold value (step S21; YES), the imaging control part 6 will transfer a process to step S3, and predetermined | prescribed imaging will be carried out. Of the frame images f continuously taken at a frame rate (e.g., 240 fps or the like), the frame image f to be processed is subtracted under a predetermined condition (in this case, selected by eight to one ratio) and specified. (Step S3). That is, the imaging control unit 6 is configured at every predetermined interval longer than the interval corresponding to the recording frame rate corresponding to the high speed video recording among the frame images f continuously taken at a predetermined imaging frame rate (for example, 240 fps or the like). The picked-up frame image f is specified as a process target.
Subsequently, the imaging control unit 6 state detection unit 6b performs image data of the luminance chrominance signal of the frame image f of the processing target that is output from the image generating unit 4 and inputted in the same manner as the imaging process of the first embodiment. After detecting the subject state based on the YUV data (step S4), the subject detecting unit 5 outputs various kinds of image data (YUV data) of each frame image f inputted from the image generating unit 4 and input. Image processing is performed to detect a region (for example, a face region, etc.) containing a specific subject (step S5).
At this time, the imaging control unit 6 sets the imaging condition of the subject in the moving image to the respective frame images f photographed with a predetermined interval longer than the interval according to the recording frame rate corresponding to high-speed moving image shooting. It adjusts by the imaging condition adjustment part 6c so that it may change gently. Specifically, the imaging control unit 6 corresponds to the state of the subject detected from the previous frame image f with respect to each of at least one frame image f between the two frame images f and f photographed with a predetermined gap. Then, the imaging conditions are adjusted so as to gradually change from the imaging conditions adjusted by the imaging condition adjusting unit 6c to the imaging conditions adjusted by the imaging condition adjusting unit 6c corresponding to the state of the subject detected from the frame image f later.
Thereafter, the central control unit 14 shifts the processing to step S7 in the same manner as described above, and captures the frame image f generated by the image generating unit 4 by being picked up at a period corresponding to the recording frame rate corresponding to high-speed video shooting. As the recording frame image f, YUV data of the frame image f is stored in the buffer memory 12 (step S7).
As described above, according to the imaging device 200 of the second embodiment, when the size of an operation occurring in the apparatus main body is larger than a predetermined threshold value when recording a moving picture at a second recording frame rate corresponding to high-speed moving picture shooting. For each frame image f photographed with a predetermined gap longer than the interval corresponding to the second recording frame rate, the imaging condition of the subject is adjusted so that the recording state of the subject in the moving picture is smoothly changed. In the case where the operation is large, the imaging condition of the subject may be adjusted in consideration of the change in the subject state caused by the change of the background. That is, when imaging is performed without moving the apparatus main body to confirm the brightness or color tone of the main subject, the recording state of the subject can be prevented from changing according to the change in the imaging condition of the subject. That is, the brightness or color tone of the main subjects during slow motion reproduction such as a decisive moment can be appropriately confirmed.
On one side, for example, when the operation of the apparatus main body, such as when imaging with the imaging device 200 being fun, is large, confirmation of the brightness and color tone of the main subject does not become the main purpose. The imaging condition of the subject may be adjusted in consideration of the change in the subject state. That is, when the moving picture data is reproduced, the image adjusted to the appropriate exposure or the white balance according to the situation of the subject can be viewed.
At this time, for each of the at least one frame image f between the two frame images f, f photographed so that the recording state of the subject changes slowly, that is, with a predetermined gap longer than the interval corresponding to the second recording frame rate, By adjusting the imaging conditions of the subject so as to gradually change from the imaging conditions adjusted in response to the state of the subject detected from the previous frame image f to the imaging conditions adjusted in correspondence with the state of the subject detected from the subsequent frame image f, During recording of moving pictures at a recording frame rate corresponding to moving picture shooting, it is possible to prevent a sudden change in the recording state of a subject such as brightness or color tone of a main subject. Therefore, after the video is reproduced at a predetermined playback frame rate, the recording state of the subject such as brightness or color tone of the main subject does not change suddenly, but in consideration of the change of the subject state due to the change of the background. The brightness or color tone of the main subject can be checked appropriately.
And in the said Example 2, when the main body of the imaging device 200 is fixed to a tripod etc., for example, and the magnitude | size of the operation | movement which generate | occur | produces in the said apparatus main body is not larger than a predetermined threshold value, the state detection part 6b will pick up an image. The imaging condition adjustment unit 6c performs the automatic white balance adjustment process (AWB) without detecting the gray component (tone) of the frame image f to be processed, which is used in the automatic white balance adjustment process (AWB) by the control unit 6. The white balance adjustment condition may not be adjusted. That is, for example, in the case where the main body of the apparatus is fixed to a tripod or the like, it is estimated that the light source does not change, and the various processes related to the automatic white balance adjustment processing (AWB) are omitted, thereby speeding up the imaging process and consuming energy. We can reduce.
7 is a block diagram showing a schematic configuration of an imaging device 300 of Embodiment 3 to which the present invention is applied.
In addition, since the imaging device 300 of Example 3 has substantially the same structure as the imaging device 200 of Example 2 except for being detailed below, detailed description is abbreviate | omitted.
In the image capturing apparatus 300 according to the third embodiment, when a predetermined moving image operation mode for automatically switching the frame rate is set at the time of shooting recording of a moving image, the magnitude of the operation occurring in the main body of the apparatus is a predetermined threshold value. While larger, the moving image is picked up at a predetermined period corresponding to the first recording frame rate corresponding to the normal moving image shooting, and automatically the high speed moving image shooting when the magnitude of the operation occurring in the main body of the apparatus falls below a predetermined threshold value. The image is captured by switching to the second recording frame rate corresponding to.
Specifically, as shown in FIG. 7, the imaging control unit 6 of the imaging apparatus 300 includes a second recording frame rate setting unit 6d.
The second recording frame rate setting section 6d switches and sets the recording frame rate in accordance with the magnitude of the operation occurring in the apparatus main body.
That is, the second recording frame rate setting section 6d determines whether the magnitude of the operation occurring in the apparatus main body detected by the motion detection section 16 is larger than a predetermined threshold value. If it is determined that the magnitude of the operation occurring in the apparatus main body is larger than a predetermined threshold value, the second recording frame rate setting section 6d determines that the recording frame rate corresponds to the recording frame rate (first recording frame rate corresponding to normal moving picture shooting). If it is determined that the magnitude of the operation occurring in the apparatus main body is not larger than a predetermined threshold value, the recording frame rate is set to the recording frame rate (second recording frame rate) corresponding to high speed video shooting.
The imaging control unit 6 is configured such that the imaging control unit 6 switches the unit circuit unit 3 by the second recording frame rate setting unit 6d so as to set a recording frame rate (for example, an image corresponding to high speed video recording). It operates at a predetermined timing according to two recording frame rates, etc. to convert an analog image signal corresponding to the optical image of the subject output from the electronic imaging unit 2 into a digital image signal (frame image f).
Next, the imaging process by the imaging device 300 is demonstrated with reference to FIG. 8 and FIG.
8 is a flowchart showing an example of an operation relating to an imaging process. 9 is a figure for demonstrating an imaging process.
In addition, since the imaging process of Example 3 is the same as the imaging process of Example 1 except that the recording frame rate is changed and set according to the magnitude | size of the operation | movement which arises in an apparatus main body, its detailed description Is omitted.
As shown in FIG. 8, first, the imaging control unit 6 drives the electronic imaging unit 2 at a predetermined imaging frame rate (for example, 240 fps or the like) similarly to the imaging process of the first embodiment. The frame image f is taken in by converting the optical image of the subject formed by the lens unit 1 into a two-dimensional image signal (RGB image data) (step S1).
Next, the second recording frame rate setting unit 6d determines whether the magnitude of the operation occurring in the apparatus main body detected by the motion detection unit 16 is larger than a predetermined threshold value (step S31). That is, the second recording frame rate setting unit 6d determines whether or not an operation larger than a predetermined threshold occurs in the main body of the apparatus, for example, by a fun operation or the like in a predetermined direction of the main body of the imaging apparatus 100. Determine whether or not.
In step S31, when the second recording frame rate setting unit 6d determines that the magnitude of the operation occurring in the apparatus main body is larger than a predetermined threshold value (step S31; YES), the recording frame rate is set to normal video shooting. The corresponding recording frame rate is set (step S32).
Thereafter, the processes of steps S3 to S7 are performed similarly to the imaging process of the first embodiment.
That is, the imaging control unit 6 selects a frame image f (e.g., frame image f1, etc .; see FIG. 9) to be processed according to the recording frame rate of the normal moving picture shooting, and the predetermined imaging frame rate (e.g., For example, it extracts from the frame image f taken in continuously at 240 fps etc. (in this case, it selects by one ratio to eight), and specifies it (step S3). Subsequently, the imaging control unit 6 state detection unit 6b outputs the subject state based on the image data (YUV data) of the luminance chrominance signal of the frame image f to be processed and input from the image generation unit 4. It detects (step S4). Next, the subject detecting unit 5 performs various image processing on the image data (YUV data) of each frame image f input and output from the image generating unit 4 at predetermined intervals in accordance with the recording frame rate of normal moving picture shooting. Is performed to detect a region (for example, a face region, etc.) containing a specific subject (step S5).
On the other hand, in step S31, when it is determined that the magnitude of the operation occurring in the apparatus main body is not larger than a predetermined threshold value (step S31; NO), the second recording frame rate setting unit 6d makes a high speed recording frame rate. The recording frame rate corresponding to moving picture shooting is set (step S33).
Next, similarly to the imaging process of the first embodiment, the imaging controller 6 captures the imaging condition adjusting unit so as to maintain a predetermined imaging condition before the recording frame rate is switched to the recording frame rate corresponding to the high-speed moving image shooting. 6c) (step S8).
Thereafter, the central control unit 14 shifts the process to step S7 to capture a frame image f generated by the image generating unit 4 at a predetermined period corresponding to the recording frame rate corresponding to the high speed video shooting (e.g., For example, the frame image f2 and the like; see FIG. 9) are stored as the recording frame image f in the buffer memory 12 in the YUV data of the frame image f (step S7).
As described above, according to the image capturing apparatus 300 of the third embodiment, when the magnitude of the motion occurring in the apparatus main body is equal to or less than a predetermined threshold value, the moving image at a predetermined cycle according to the second recording frame rate corresponding to the high speed moving image photographing. Image is taken at a predetermined period according to the first recording frame rate corresponding to normal moving picture shooting, when the size of the operation is larger than a predetermined threshold value, so that the recording frame according to the size of the operation occurring in the apparatus main body. Can be set by switching the rate automatically.
That is, when predetermined operation of the operation input unit 11 by the user is required to switch the recording frame rate, the apparatus main body moves in accordance with the predetermined operation by the user, and a shaken image is captured. Therefore, by automatically switching and setting the recording frame rate in accordance with the magnitude of the operation occurring in the apparatus main body, the predetermined operation of the operation input unit 11 by the user for switching the recording frame rate is unnecessary, and a shaken image is captured. Discardment can be prevented, and the state of the main subject can be appropriately checked when the moving picture data is reproduced.
In addition, this invention is not limited to the said Example, You may change various improvement and a design in the range which does not deviate from the meaning of this invention.
For example, in the first to third embodiments, the imaging control unit 6 is configured to generate a recording frame rate corresponding to a first recording frame rate corresponding to normal moving picture shooting and a high speed moving picture shooting according to a change in the state of a subject to be imaged. It may be set by switching to two recording frame rates. That is, when predetermined operation of the operation input unit 11 by the user is required to switch the recording frame rate, the apparatus main body moves in accordance with the predetermined operation by the user, and a shaken image is captured. Thus, for example, when the change in the state of the subject to be imaged is relatively large, the recording frame rate is automatically switched to the second recording frame rate corresponding to the high speed moving picture shooting, so that each frame image is reproduced by subsequent playback of the moving picture. The eye whose f imaging time is shorter than the reproduction interval can be reproduced in slow motion, and the state of the main subject can be checked appropriately.
In addition, although the state detection part 6b and the imaging condition adjustment part 6c were set as the classification structure in the said Example 1-3, you may comprise these integrally. That is, you may make the imaging condition adjustment part 6c equip the function provided with the state detection part 6b which detects a subject state.
In addition, the structure of the imaging device 100, 200, 300 is an example illustrated in the said Example, It is not limited to this, At least the imaging means, imaging control means, reproduction control means, adjustment means, adjustment control means are included. Any configuration can be appropriately changed.
In addition, in the above embodiment, the functions of the moving picture recording means, the adjusting means, the switching means, and the adjusting control means are recorded under the control of the central control unit 14, the recording medium M, the imaging condition adjusting unit 6c, and the first recording frame. Although it is set as the structure implement | achieved by driving the rate setting part 6a and the imaging control part 6, it is not limited to this, It is good also as a structure implemented by execution of a predetermined program etc. by CPU of the central control part 14 .
In other words, a program including a moving picture recording processing routine, an adjustment processing routine, a switching processing routine, and an adjustment control processing routine is stored in the program memory 13 which stores the program. The CPU of the central control unit 14 may be made to function as moving picture recording means for recording the moving picture of a subject sequentially picked up by the imaging means as one continuous moving picture data from the moving picture recording processing routine. The CPU of the central control unit 14 adjusts the imaging conditions of the subject in accordance with a change in the state of the subject imaged by the imaging means during recording of one continuous moving image data by the moving image recording means from the adjustment processing routine. You may make it function as an adjustment means. In addition, the CPU of the central control unit 14 may be made to function as a switching means for switching the frame rate at the time of recording the moving picture during recording of one continuous moving picture data by the moving picture recording means from the switching processing routine. Further, from the adjustment control processing routine, the CPU of the central control unit 14 is changed from the first recording frame rate to the second recording frame rate which is faster than the first recording frame rate when the moving picture is recorded by the switching means. In the case of switching, it may be made to function as adjustment control means for restricting adjustment of the imaging condition by the adjustment means in the recording at this second recording frame rate.
Similarly, the reproducing means, the reproducing control means, the motion detecting means, the state detecting means, the image capturing control means, and the subject detecting means have a configuration realized by executing a predetermined program or the like by the CPU of the central control unit 14. You may also
In addition, a non-volatile memory such as a flash memory, a portable recording medium such as a CD-ROM, or the like can be used as a computer-readable medium storing a program for executing each of the above processes. . In addition, a carrier wave (carrier wave) is also applied as a medium for providing program data through a predetermined communication line.
In addition, the Example disclosed this time is an illustration in all the points, Comprising: It should not be considered restrictive. The scope of the present invention is indicated not by the above description but by the claims, and is intended to include all modifications within the meaning and range of equivalency of the claims.
Below, the invention described in the original claim of this application is appended.
That is, the imaging device of the present invention is a moving picture recording unit that sequentially records images of a subject sequentially picked up by the imaging unit as one continuous moving picture data, and during imaging and recording of one continuous moving picture data by the moving picture recording unit. A frame rate for recording a moving picture during image capturing and recording of one continuous moving picture data by the moving picture recording unit; And a switching unit for switching the switching unit, and when the frame rate at the time of recording the moving picture is changed from the first recording frame rate to the second recording frame rate which is faster than the first recording frame rate. An adjusting agent for restricting adjustment of imaging conditions by the adjusting unit during recording at a recording frame rate And it employs a configuration that includes a.
Further, the adjustment control section further restricts the adjustment of the imaging condition by the adjustment section so as to maintain the imaging condition adjusted before the switching when switching from the first recording frame rate to the second recording frame rate, or You may restrict adjustment of the imaging conditions by the said adjustment part so that imaging conditions may change more smoothly than before this switching.
In addition, a reproduction unit for reproducing the moving picture data recorded by the moving picture recording unit at the same frame rate as the recording rate, and moving picture data recorded in a form in which the frame rate during recording is temporarily switched by the switching unit. Is reproduced by the reproducing section, a reproducing control section for reproducing the frame rate at the time of reproducing at the time of reproducing the portion where the frame rate at the time of recording is temporarily switched at a frame rate different from the frame rate at the time of recording is added. You may provide as.
Further, the playback control section further includes the first recording so that, when continuously playing back the entirety of one video data recorded by the video recording section, the portion recorded at the second recording frame rate is automatically reproduced in slow motion. The entirety of the moving image data may be continuously reproduced at the same frame rate as the first recording frame rate without changing the frame rate at the time of reproduction of the portion recorded at the recording frame rate and the portion recorded at the second recording frame rate. .
The apparatus further includes a state detection unit that detects a subject state in accordance with a plurality of frame images generated by the imaging of the moving image of the subject by the imaging unit, wherein the state detecting unit captures an image of the moving image at the second recording frame rate. At the time, the subject state may be detected for each frame image picked up with a predetermined gap longer than the interval corresponding to the second recording frame rate.
The apparatus further includes a motion detector for detecting a magnitude of the motion occurring in the main body of the apparatus, wherein the adjustment controller is configured to determine a magnitude of the motion detected by the motion detector at the time of recording the video at the second recording frame rate. In the case where the value is larger than the value, the recording state of the subject in the moving picture is smoothly changed based on the state of the subject detected from each frame image picked up with a predetermined gap longer than the interval corresponding to the second recording frame rate. It is also possible to adjust the limited imaging conditions by the adjustment unit.
In addition, the adjustment control unit is further configured for each of two frame images picked up with a predetermined gap longer than an interval corresponding to the second recording frame rate when recording moving pictures at the second recording frame rate. The image sensing adjusted according to the state of the subject detected from the later frame image from the image capturing conditions detected by the state detecting unit and adjusted according to the state of the subject detected from the previous frame image among the two frame images. You may make adjustment of the limited imaging conditions by the said adjustment part so that it may change gradually with conditions.
In addition, the state detector further detects a subject state sequentially for each frame image picked up at a period corresponding to the first recording frame rate when recording a moving image at the first recording frame rate. In addition, according to the state of the subject which was sequentially detected by the said state detection part, you may adjust the imaging conditions of a subject by the said adjustment part sequentially.
Further, the adjustment control section further includes a subject for each frame image picked up at a period corresponding to the first recording frame rate when the switching section switches from the second recording frame rate to the first recording frame rate. The adjustment of the imaging condition by the adjustment unit may be limited so that the imaging condition of the subject changes slowly.
A motion detector for detecting the magnitude of the motion occurring in the main body of the apparatus, and when the magnitude of the motion detected by the motion detector is less than or equal to a predetermined value, causes the image pickup unit to capture a moving image at a period corresponding to the second recording frame rate. On the other hand, when the magnitude | size of the operation | movement detected by the said detection part is larger than a predetermined value, you may further be provided with the imaging control part which image | photographs a moving image by the said imaging part in the period according to the said 1st recording frame rate.
Further, the switching unit may further switch the frame rate at the time of recording the moving picture to the first recording frame rate and the second recording frame rate in accordance with a switching instruction of the recording frame rate input in accordance with a predetermined operation by the user. do.
The switching unit may further switch the frame rate at the time of recording the moving picture to the first recording frame rate and the second recording frame rate in accordance with a change in the state of the subject imaged by the imaging unit.
The imaging condition may include at least one of an exposure adjustment condition and a white balance adjustment condition at the time of imaging the subject by the imaging unit.
The apparatus may further include a subject detecting unit detecting a specific subject from the moving image captured by the image capturing unit, wherein the adjusting unit is configured to adjust the exposure adjustment condition and the white balance based on the specific subject detected by the subject detecting unit. At least one of the conditions may be adjusted.
Moreover, the imaging processing method of this invention is an imaging processing method using the imaging device provided with an imaging part, The process of sequentially recording the moving picture of the subject imaged by the said imaging part as one continuous moving image data, The said 1 During imaging and recording of two consecutive moving picture data, the moving picture is taken during the processing of adjusting the imaging conditions of the subject according to the change of the subject state picked up by the imaging unit, and during the imaging and recording of the one continuous moving picture data. When the frame rate at the time of recording and the frame rate at the time of recording the moving picture are switched from the first recording frame rate to the second recording frame rate which is faster than the first recording frame rate, A phrase including processing for limiting adjustment of the imaging condition during recording at two recording frame rates And the employed.
A moving picture recording unit for sequentially recording images of a subject photographed sequentially by the imaging unit as one continuous moving picture data;
An adjusting unit for adjusting imaging conditions of the subject in accordance with a change in the state of the subject captured by the imaging unit during imaging and recording of one continuous moving image data by the moving image recording unit;
A switching unit for switching a frame rate when recording moving images during imaging and recording of one continuous moving image data by the moving image recording unit;
The adjustment control unit also,
When switching from the first recording frame rate to the second recording frame rate, the adjustment of the imaging conditions by the adjusting unit is maintained so as to maintain the imaging conditions adjusted before the switching, or the imaging conditions in comparison with before the switching. An image capturing apparatus for restricting adjustment of image capturing conditions by the adjusting unit so that the rate of change of the photo is changed below a predetermined ratio.
A reproducing unit for reproducing the moving picture data recorded by the moving picture recording unit at the same frame rate as the recording frame rate;
When reproducing moving picture data recorded in a form in which the frame rate at the time of recording is temporarily switched by the switching unit, the reproduction time at the time of reproducing the portion at which the frame rate at the time of recording is switched. Playback control section for reproducing the frame rate at a frame rate different from the frame rate at the time of recording
The playback control unit also,
A portion recorded at the first recording frame rate so that the portion recorded at the second recording frame rate is automatically reproduced in slow motion when the entirety of one moving image data recorded by the moving image recording unit is continuously reproduced; An image pickup apparatus, wherein the entirety of the moving image data is continuously reproduced at the same frame rate as the first recording frame rate without changing the frame rate at the time of reproduction of the portion recorded at the second recording frame rate.
And a state detecting unit detecting a state of a subject in accordance with a plurality of frame images generated by imaging of a moving image of the subject by the imaging unit.
The state detection unit,
And an image capturing apparatus detects a subject state for each frame image picked up with a predetermined gap longer than an interval corresponding to the second recording frame rate when imaging a moving image at the second recording frame rate.
Further comprising a motion detector for detecting the magnitude of the motion occurring in the apparatus main body,
The adjustment control unit,
When recording motion pictures at the second recording frame rate, when the magnitude of the motion detected by the motion detection unit is larger than a predetermined value, the image is captured with a predetermined gap longer than an interval corresponding to the second recording frame rate. And the limited image pickup condition is adjusted by the adjustment unit so that the recording state of the subject in the moving picture is changed at a change rate equal to or less than a predetermined ratio, based on the state of the subject detected from each frame image.
When recording moving pictures at the second recording frame rate, the state detection unit detects a subject state for each of two frame images picked up with a predetermined gap longer than an interval corresponding to the second recording frame rate. And from the imaging conditions adjusted in response to the state of the subject detected from the previous frame image among the two frame images, to the imaging conditions adjusted in correspondence with the state of the subject detected from the subsequent frame image, the rate of change of a predetermined ratio or less. The imaging device which adjusts the limited imaging conditions by the said adjustment part so that it may change into.
When recording moving pictures at the first recording frame rate, the subject state is sequentially detected for each frame image picked up at a period corresponding to the first recording frame rate,
And the image capturing conditions are sequentially adjusted by the adjusting unit in accordance with the state of the subjects sequentially detected by the state detecting unit.
In the case where the switching unit switches from the second recording frame rate to the first recording frame rate, recording conditions of the subject are recorded for each frame image picked up at a period corresponding to the first recording frame rate. An imaging device which limits the adjustment of imaging conditions by the adjustment unit so that the state changes at a rate of change equal to or less than a predetermined ratio.
A motion detector for detecting the magnitude of the motion occurring in the apparatus main body,
When the magnitude of the motion detected by the motion detector is less than or equal to a predetermined value, the motion image is picked up by the imaging section at a period according to the second recording frame rate, while the magnitude of the motion detected by the detector is greater than a predetermined value. An image capturing control section which causes the image capturing section to capture a moving image at a period in accordance with the first recording frame rate when large
The conversion section also,
An image pickup apparatus according to a switching instruction of a recording frame rate input in accordance with a predetermined operation by a user, to switch the frame rate at the time of recording the moving picture into the first recording frame rate and the second recording frame rate.
And a frame rate at the time of recording the moving picture into the first recording frame rate and the second recording frame rate in accordance with a change in the subject state picked up by the imaging unit.
The imaging device includes at least one of an exposure adjustment condition and a white balance adjustment condition at the time of imaging the subject by the imaging unit.
And a subject detecting unit which detects a specific subject from the moving image photographed by the imaging unit.
And the adjustment unit adjusts at least one of the exposure adjustment condition and the white balance adjustment condition on the basis of a specific subject detected by the subject detection unit.
In the imaging processing method using the imaging device provided with an imaging unit,
A process of sequentially recording moving images of subjects sequentially picked up by the imaging unit as one continuous moving image data;
A process of adjusting imaging conditions of the subject in accordance with a change in the state of the subject imaged by the imaging unit during imaging and recording of the one continuous video data;
Processing for switching the frame rate at the time of recording a moving picture during the imaging and recording of said one continuous moving picture data;
Imaging processing method comprising a.
The adjustment controller is configured to perform the second recording when the frame rate at the time of recording the moving picture by the switching unit is changed from a first recording frame rate to a second recording frame rate which is lower than the first recording frame rate. An imaging device that allows, without limitation, adjustment of imaging conditions by the adjustment unit during recording at a frame rate.
KR1020120006879A 2011-01-20 2012-01-20 Imaging apparatus and imaging method for taking moving image KR101342477B1 (en)
JPJP-P-2011-009430 2011-01-20
JP2011009430A JP5234119B2 (en) 2011-01-20 2011-01-20 Imaging apparatus, imaging processing method, and program
KR20120084696A KR20120084696A (en) 2012-07-30
KR101342477B1 true KR101342477B1 (en) 2013-12-17
ID=46528985
KR1020120006879A KR101342477B1 (en) 2011-01-20 2012-01-20 Imaging apparatus and imaging method for taking moving image
US (1) US20120189263A1 (en)
JP (1) JP5234119B2 (en)
KR (1) KR101342477B1 (en)
CN (1) CN102611845B (en)
JP6198600B2 (en) 2013-12-16 2017-09-20 キヤノン株式会社 Image processing apparatus, imaging apparatus, control method thereof, and program
CN104980640A (en) * 2014-04-02 2015-10-14 中兴通讯股份有限公司 Method and device for image photographing in driving
US20160088219A1 (en) * 2014-09-22 2016-03-24 Casio Computer Co., Ltd. Image capture apparatus which controls frame rate based on motion of object, information transmission apparatus, image capture control method, information transmission method, and recording medium
EP3214832B1 (en) 2014-10-31 2019-11-27 Fujifilm Corporation Imaging device and method for recognizing target object
CN104394392B (en) * 2014-11-14 2016-09-28 广东欧珀移动通信有限公司 A kind of white balance adjusting method, device and terminal
US9860507B2 (en) * 2015-06-08 2018-01-02 Qualcomm Incorporated Dynamic frame skip for auto white balance
TWM519367U (en) * 2015-12-30 2016-03-21 Trans Electric Co Ltd Camera system capable of fast switching recording mode
US20180213150A1 (en) * 2017-01-24 2018-07-26 Qualcomm Incorporated Adaptive buffering rate technology for zero shutter lag (zsl) camera-inclusive devices
US10438630B2 (en) * 2017-02-10 2019-10-08 Canon Kabushiki Kaisha Display control apparatus that performs time-line display, method of controlling the same, and storage medium
CN106657680A (en) * 2017-03-10 2017-05-10 广东欧珀移动通信有限公司 Mobile terminal frame rate control method and device and mobile terminal
CN107220620A (en) * 2017-05-27 2017-09-29 北京小米移动软件有限公司 Face identification method and device
CN109308778A (en) * 2018-09-11 2019-02-05 深圳市智美达科技股份有限公司 Mobile detection alarm method, device, acquisition equipment and storage medium
JP2007006343A (en) 2005-06-27 2007-01-11 Olympus Corp Imaging system
JP2010016544A (en) 2008-07-02 2010-01-21 Nikon Corp Image capturing apparatus and image processing apparatus, and image processing program
JP2010074638A (en) 2008-09-19 2010-04-02 Fuji Xerox Co Ltd Photographing support device, photographing system, and program
JP2007195038A (en) * 2006-01-20 2007-08-02 Sony Corp Imaging device and image processing method
JP4603985B2 (en) * 2006-01-20 2010-12-22 キヤノン株式会社 Imaging apparatus, imaging method, and control program
JP4895016B2 (en) * 2006-09-28 2012-03-14 三洋電機株式会社 Imaging device
JP4863499B2 (en) * 2007-05-01 2012-01-25 キヤノン株式会社 Image recording apparatus and control method thereof
JP4556995B2 (en) * 2007-12-10 2010-10-06 カシオ計算機株式会社 Imaging apparatus, exposure control method thereof, and exposure control program
JP2010171748A (en) * 2009-01-23 2010-08-05 Casio Computer Co Ltd Imaging apparatus and imaging control program
2011-01-20 JP JP2011009430A patent/JP5234119B2/en active Active
2012-01-18 US US13/352,607 patent/US20120189263A1/en not_active Abandoned
2012-01-18 CN CN201210015505.6A patent/CN102611845B/en active IP Right Grant
2012-01-20 KR KR1020120006879A patent/KR101342477B1/en active IP Right Grant
US20120189263A1 (en) 2012-07-26
JP2012151706A (en) 2012-08-09
JP5234119B2 (en) 2013-07-10
CN102611845A (en) 2012-07-25
KR20120084696A (en) 2012-07-30
CN102611845B (en) 2014-08-06