Source: http://www.google.com/patents/US7826092?ie=ISO-8859-1&dq=7,752,326
Timestamp: 2014-09-19 00:52:51
Document Index: 336251042

Matched Legal Cases: ['Application No. 10', 'Application No. 11', 'Application No. 11', 'Application No. 11', 'Application No. 11', 'Application No. 10', 'Application No. 10']

Patent US7826092 - Image processing apparatus having image selection function, and recording ... - Google PatentsSearch Images Maps Play YouTube News Gmail Drive More »Sign in<nobr>Advanced Patent Search</nobr>PatentsAn image processing apparatus having an image selecting function, includes: an evaluation device that takes in a plurality of sets of image data of a subject obtained through image-capturing and performs acceptability evaluation on each of the plurality of sets of image date; and an acceptability selection...http://www.google.com/patents/US7826092?utm_source=gb-gplus-sharePatent US7826092 - Image processing apparatus having image selection function, and recording medium having image selection function programAdvanced Patent SearchPublication numberUS7826092 B2Publication typeGrantApplication numberUS 11/454,906Publication dateNov 2, 2010Filing dateJun 19, 2006Priority dateNov 20, 1998Fee statusPaidAlso published asUS7088865, US20050219666, US20060256396Publication number11454906, 454906, US 7826092 B2, US 7826092B2, US-B2-7826092, US7826092 B2, US7826092B2InventorsSatoshi Ejima, Hirotake Nozaki, Fumio HiraideOriginal AssigneeNikon CorporationExport CitationBiBTeX, EndNote, RefManPatent Citations (17), Referenced by (8), Classifications (18), Legal Events (1) External Links: USPTO, USPTO Assignment, EspacenetImage processing apparatus having image selection function, and recording medium having image selection function programUS 7826092 B2Abstract An image processing apparatus having an image selecting function, includes: an evaluation device that takes in a plurality of sets of image data of a subject obtained through image-capturing and performs acceptability evaluation on each of the plurality of sets of image date; and an acceptability selection device that selects image data ranked high in the acceptability evaluation among the plurality of sets of image data having undergone the acceptability evaluation performed at the evaluation device.
an evaluation device that takes in a plurality of sets of image data obtained through continuous image-capturing and performs acceptability evaluation on each of the plurality of sets of image data within an evaluation area set to occupy a portion of an image plane; and
an acceptability selection device that selects image data ranked high in the acceptability evaluation among the plurality of sets of image data having undergone the acceptability evaluation performed at said evaluation device and records the image data into a recording medium,
wherein said evaluation device sets evaluation weighting toward a periphery of the evaluation area lower than an evaluation weighting at a central portion of the evaluation area.
2. An image processing apparatus having an image selecting function, comprising:
wherein a plurality of evaluation areas are set at a plurality of locations within the image plane; and
wherein said evaluation device performs integrated evaluation of acceptability of image data based upon individual evaluations performed in the evaluation areas.
3. An image processing apparatus having an image selecting function, comprising:
an evaluation device that takes in a plurality of sets of image data obtained through continuous image-capturing and performs acceptability evaluation on each of the plurality of sets of image data within an evaluation area set to occupy a portion of an image plane;
an acceptability selection device that selects image data ranked high in the acceptability evaluation among the plurality of sets of image data having undergone the acceptability evaluation performed at said evaluation device and records the image data into a recording medium; and
an area setting device that selects an evaluation area or selects and changes weighting of evaluation areas.
said area setting device selects an evaluation area by excluding light areas and dark areas in the image plane or by setting evaluation weighting for light areas and dark areas at a relatively low level.
said area setting device selects an evaluation area by selecting an area that is in a focus-verified state in the image plane or by setting evaluation weighting for the area that is in a focus-verified state at a relatively high level.
6. An image processing apparatus according to claim 3, further comprising:
an image-capturing device that continuously captures images of a subject, wherein:
said area setting device is also utilized to select a photometric area for said image-capturing device, and in correspondence to either the photometric area or the evaluation area that is determined first, the other area is determined.
7. An image processing apparatus according to claim 3, further comprising:
said area setting device is also utilized to select a focal point detection area for said image-capturing device, and in correspondence to either the focal point detection area or the evaluation area that is determined first, the other area is determined.
a lock device that fixes exposure adjustment in response to external operation, wherein:
said area setting device clears or re-sets the evaluation area when said lock device has fixed the exposure adjustment.
9. An image processing apparatus according to claim 7, further comprising:
a lock device that fixes focal adjustment in response to an external operation, wherein:
said area setting device clears or re-sets the evaluation area when said lock device has fixed the focal adjustment.
10. An image processing apparatus having an image selecting function, comprising:
an image-capturing device that continuously captures images of a subject;
an evaluation device that takes in a plurality of sets of image data obtained at said image-capturing device through continuous image-capturing and performs acceptability evaluation on each of the plurality of sets of image data;
a frame number changing device that changes a number of frames over which continuous image-capturing is performed at said image-capturing device.
11. An image processing apparatus according to claim 10, wherein:
said frame number changing device stops a continuous image-capturing operation performed by said image-capturing device when an evaluation made by said evaluation device indicates one of a value greater than a specific upper limit value, a value less than a specific lower limit value and a relative maximum value.
a framing detection device that detects a framing change at said image-capturing device, wherein:
said frame number changing device stops a continuous image-capturing operation by said image-capturing device when the framing change is detected by said framing detection device.
13. An image processing apparatus according to claim 10, wherein:
said frame number changing device allows a continuous image-capturing operation to be resumed at said image-capturing device when none of evaluations made by said evaluation device reach a specific threshold value.
an image-capturing device that captures an image of a subject;
a recording device that records image data obtained through image-capturing performed by said image-capturing device;
a photographic evaluation device that evaluates acceptability of a photographing state in which the image data have been obtained through image-capturing performed by said image-capturing device;
a mode setting device that, in response to an external operation, sets or clears (1) an acceptability selection mode in which image data with a high evaluation from said photographic evaluation device among image data obtained through continuous image-capturing performed by said image-capturing device are selectively recorded and (2) a continuous shooting mode in which image data corresponding to a plurality of frames obtained through continuous image-capturing performed by said image-capturing device are all recorded, to determine a photographing sequence that corresponds to a current mode setting; and
a photographic control device that implements control on said image-capturing device and said recording device in conformance to the photographing sequence determined by said mode setting device and executed photographing, wherein:
said mode setting device implements control of setting to ensure that even if an instruction is issued through an external operation for a setting whereby the acceptability selection mode and the continuous shooting mode overlap each other the acceptability selection mode and the continuous shooting mode do not overlap in setting.
15. An image processing apparatus according to claim 14, wherein:
said mode setting device implements control to ensure that if an external operation is performed to set either the continuous shooting mode or the acceptability selection mode while the other mode is set, the external operation is not accepted.
16. An image processing apparatus according to claim 14, wherein:
said mode setting device implements control to ensure that if the continuous shooting mode and the acceptability selection mode are set overlapping each other, either mode that has been set earlier is automatically cleared.
17. An image processing apparatus according to claim 16, wherein:
said mode setting device reverts to the mode set earlier and automatically cleared, if an external operation clears overlapping of mode settings.
a photographic control device that implements control on said image-capturing device and said recording device in conformance to the photographing sequence determined by said mode setting device and executes photographing, wherein:
said photographic control device executes a photographing sequence selected in correspondence to a mode given higher priority in conformance to a predetermined priority order even if the acceptability selection mode and the continuous shooting mode are set overlapping each other through an external operation.
a mode setting device that, in response to an external operation, sets or clears (1) an acceptability selection mode in which image data with a high evaluation from said photographic evaluation device among image data obtained through continuous image-capturing performed by said image-capturing device are selectively recorded and (2) a light emission mode in which light emission is performed automatically or unconditionally by controlling an external or internal flash unit at image-capturing by said image-capturing device, to determine a photographing sequence that corresponds to a current mode setting; and
said mode setting device implements control of setting to ensure that even if an instruction is issued through an external operation for a setting whereby the acceptability selection mode and the light emission mode overlap each other the acceptability selection mode and the continuous shooting mode do not overlap in setting.
20. An image processing apparatus according to claim 19, wherein:
said mode setting device implements control to ensure that if an external operation is performed to set either the light emission mode or the acceptability selection mode while the other mode is set, the external operation is not accepted.
21. An image processing apparatus according to claim 19, wherein:
said mode setting device implements control to ensure that if the light emission mode and the acceptability selection mode are set overlapping each other, either mode that has been set earlier is automatically cleared.
22. An image processing apparatus according to claim 21, wherein:
said photographic control device executes a photographing sequence selected in correspondence to a mode given higher priority in conformance to a predetermined priority order even if the acceptability selection mode and the light emission mode are set overlapping each other through an external operation. Description
This is a Divisional of application Ser. No. 11/042,068 filed Jan. 26, 2005, which is a Continuation of application Ser. No. 09/443,293 filed Nov. 19, 1999. The entire disclosure of the prior application is hereby incorporated by reference herein in its entirety.
Japanese Patent Application No. 10-331367 Nov. 20, 1998 Japanese Patent Application No. 11-009077 Jan. 18, 1999 Japanese Patent Application No. 11-009078 Jan. 18, 1999 Japanese Patent Application No. 11-009079 Jan. 18, 1999 Japanese Patent Application No. 11-009080 Jan. 18, 1999 The disclosures of U.S. Pat. No. 5,594,554. Japanese Patent Application No. 10-284531 and Japanese Patent Application No. 10-236102 are herein incorporated by reference.
To provide a solution to problems caused by such camera vibration, there are cameras having a camera vibration correction mechanism in the known art. FIG. 25 illustrates a camera of this type, having a camera vibration correction mechanism. In FIG. 25, a taking lens 92 is mounted at the front surface of a camera 91. Inside the lens barrel of the taking lens 92, a camera vibration correction optical system 93 is rotatably provided.
SUMMARY OF THE INVENTION An object of the present invention is to provide an image processing apparatus that selects image data obtained in a good photographing state and achieving a high image quality for storage.
An image processing apparatus according to the present invention having an image selecting function, comprises: an evaluation device that takes in a plurality of sets of image data obtained through continuous image-capturing and performs acceptability evaluation on each of the plurality of sets of image data within an evaluation area set to occupy a portion of an image plane; and an acceptability selection device that selects image data ranked high in the acceptability evaluation among the plurality of sets of image data having undergone the acceptability evaluation performed at the evaluation device and records the image data into a recording medium.
In the structure described above, the image-capturing device performs continuous image-capturing to obtain image data corresponding to a plurality of frames in a single photographing operation. The evaluation device evaluates the acceptability of the photographing state, the acceptability of the image quality or the like for individual sets of such image data. The selection operation device displays both the image data and the results of the acceptability evaluations. The photographer engages in an image selection operation by referring to the display to accurately select image data obtained in a good photographing state for storage.
In the structure described above, the image-capturing device performs continuous image-capturing to obtain image data corresponding to a plurality of frames in a single photographing operation. The evaluation device evaluates the acceptability of the photographing state, the acceptability of the image quality or the like for individual sets of such image data. The selection operation device displays the image data in the order of rankings in the acceptability evaluation. The photographer engages in an image selection operation by referring to the display to accurately select image data obtained in a good photographing state for storage.
Another image processing apparatus having an image selecting function, comprises: a compression device that engages in compression processing on image data; an evaluation device that controls the compression device to compresses a plurality of sets of image data obtained through continuous image-capturing by using a compression parameter for acceptability evaluation and performs acceptability evaluation on each set of image data based upon a resulting post-compression code volume; and an acceptability selection device that selects image data ranked high in the acceptability evaluation among the plurality of sets of image data having undergone the acceptability evaluation at the acceptability evaluation device and records the selected image data into a recording medium in a state in which the selected image data are compressed via the compression device to achieve a target post-compression code volume for image recording
Another image processing apparatus according to the present invention comprises: an image-capturing device that captures an image of a subject; a recording device that records image data obtained through image-capturing performed by the image-capturing device; a photographic evaluation device that evaluates acceptability of a photographing state in which the image data have been obtained through image-capturing performed by the image-capturing device; a mode setting device that, in response to an external operation, sets or clears (1) an acceptability selection mode in which image data with a high evaluation from the photographic evaluation device among image data obtained through continuous image-capturing performed by the image-capturing device are selectively recorded and (2) a continuous shooting mode in which image data corresponding to a plurality of frames obtained through continuous image-capturing performed by the image-capturing device are all recorded, to determine a photographing sequence that corresponds to a current mode setting; and a photographic control device that implements control on the image-capturing device and the recording device in conformance to the photographing sequence determined by the mode setting device and executes photographing. And the mode setting device implements control of setting to ensure that even if an instruction is issued through an external operation for a setting whereby the acceptability selection mode and the continuous shooting mode overlap each other the acceptability selection mode and the continuous shooting mode do not overlap in setting.
Normally, when an acceptability selection mode and a continuous shooting mode are set at the same time, an acceptability selection operation is executed for the individual frames photographed through the continuous shooting operation (image-capturing for a plurality of frames->acceptability selection), thereby causing a problem of a serious reduction in the continuous shooting speed. As a solution, in the structure described above, one of (B1)-(B3) below is implemented as a device to ensure that the acceptability selection mode and the continuous shooting mode are prevented from being set at the same time
The mode setting device automatically (forcibly) clears at least one of the modes when the acceptability selection mode and the continuous shooting mode overlap. This ensures that the acceptability selection mode and the continuous shooting mode are never set at the same time, thereby eliminating problems caused by the two modes being used together with a high degree of reliability. In particular, during such an operation, by giving priority to the mode to be set anew and automatically clearing the mode that was previously set, the most recent photographing intention of the photographer can be accurately reflected in the mode setting of the image processing apparatus. In addition, in this case, the photographer is not required to clear the previous mode that was set before any problems occur due to the setting of the new mode. As a result, the operability in mode setting further improves. Moreover, during such an operation, by fixing one specific mode as the mode to be automatically cleared regardless of the sequence of external operations, the priority order of the modes can be determined in advance. For instance, by setting the acceptability selection mode as the mode to be automatically cleared when the acceptability selection mode and the continuous shooting mode overlap, the continuous shooting mode can be given priority over the acceptability selection mode for execution at all times.
Another image processing apparatus according to the present invention comprises; an image-capturing device that captures an image of a subject; a recording device that records image data obtained through image-capturing performed by the image-capturing device; a photographic evaluation device that evaluates acceptability of a photographing state in which the image data have been obtained through image-capturing performed by the image-capturing device; a mode setting device that, in response to an external operation, sets or clears (1) an acceptability selection mode in which image data with a high evaluation from the photographic evaluation device among image data obtained through continuous image-capturing performed by the image-capturing device are selectively recorded and (2) a light emission mode in which light emission is performed automatically or unconditionally by controlling an external or internal flash unit at image-capturing by the image-capturing device, to determine a photographing sequence that corresponds to a current mode setting; and a photographic control device that implements control on the image-capturing device and the recording device in conformance to the photographing sequence determined by the mode setting device and executes photographing. And the mode setting device implements control of setting to ensure that even if an instruction is issued through an external operation for a setting whereby the acceptability selection mode and the light emission mode overlap each other the acceptability selection mode and the continuous shooting mode do not overlap in setting.
Also, preferably, the mode setting device implements control to ensure that if the light emission mode and the acceptability selection mode are set overlapping each other, either mode that has been set earlier is automatically cleared. In this case, preferably, the mode setting device reverts to the mode set earlier and automatically cleared, if an external operation clears overlapping of mode settings.
Normally, when the acceptability selection mode and the light emission mode are set at the same time, a charge standby period for light emission is inserted after each frame during a continuous image-capturing operation performed in the acceptability selection mode. This causes a problem in that the acceptability selection mode cannot be executed smoothly and quickly. In addition, during a flash photographing operation performed at night when the exposure time (light emission time) is extremely short, in particular, a camera vibration blur or a subject-motion blur does not occur readily and thus, the need to set the acceptability selection mode is not great. For these reasons, one of (C1)-(C3) below is implemented in the structure described above as a device for ensuring that the acceptability selection mode and the light emission mode are not set at the same time.
A recording medium according to the present invention has a control program to be utilized at an image processing apparatus having an image selecting function recorded therein. The control program comprising: an instruction for taking in a plurality of sets of image data of a subject obtained through image-capturing; an instruction for performing acceptability evaluation on each of the plurality of sets of image data; and an instruction for selecting image data ranked high in the acceptability evaluation among the image data having undergone the acceptability evaluation.
BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a block diagram illustrating the structure of the electronic camera in a first embodiment;
FIGS. 5A through 5C illustrate examples of positions of the various types of areas;
FIG. 9 presents examples of the selection screen display;
FIG. 10 illustrates the main routine implemented in a second embodiment:
FIG. 11 illustrates the image compression routine implemented for acceptability evaluation:
FIG. 24 illustrates how a program may be provided through a telecommunication line; and
DESCRIPTION OF THE PREFERRED EMBODIMENTS First Embodiment In the first embodiment, an electronic camera that performs acceptability evaluation and image selecting after completing a continuous image-capturing operation is achieved. The acceptability evaluation means evaluating whether or not the image is good. FIG. 1 is a block diagram illustrating the structure of an electronic camera 10. In FIG. 1, at the front surface of the electronic camera 10, a taking lens 12 is mounted. The light receiving surface of an image-capturing element 14 is positioned toward the image space of the taking lens 12 via a mirror box 13. A finder optical system 13 a is provided along the direction of the reflection of the mirror box 13.
An image output from the image-capturing element 14 is stored in an image memory 16 via an image processing unit 15 which engages in color signal processing, A/D conversion, gamma correction and the like. In addition, an image is compression unit 17 and an image display circuit 24 are connected to the data bus of the image memory 16. The image compression unit 17 is connected to a microprocessor 18, and a memory card 20 is detachably connected to the microprocessor 18 via a card interface 19.
One of the photographing modes that may be set at the electronic camera 10 is a mode for recording image data having undergone acceptability selection (hereafter referred to as �acceptability selection mode�). Normally, image data resulting from an image-capturing operation are recorded in a recording medium such as a memory card after they undergo a specific type of image processing in units of captured images. However, in the acceptability selection mode, an image, capturing operation is performed on a subject continuously under specific conditions, the acceptability of image data resulting from the continuous image-capturing operation is judged and the best image among the image data having undergone the decision-making is selected to be recorded in the recording medium.
Next, the microprocessor 18 makes a decision as to whether or not at least one set of the acceptability evaluation results exceeds a preset threshold value (step S8). If none of the acceptability evaluations are equal to or greater than the threshold value (step S8 NO), the microprocessor is returns to the operation in step 84 to perform continuous image-capturing again.
Next, the details of the various subroutines mentioned above are individually explained.
1) Spot photometric mode: An area (a) in FIG. 5A is set as the photometric area. 2) Centrally weighted photometric mode: Areas (a) and (b) in FIG. 5A are set as photometric areas (the area (a) is weighted greater than the area (b)). 3) Multi-photometric mode: Among areas (a)-(f) in FIG. 5A, a light area (EV11 or higher) and a dark area (EV3 or lower) where the gradation reproducibility is reduced are excluded, and the remaining areas are set as photometric areas. Next, the microprocessor 18 uses the photometric areas thus set and their evaluation weighting unchanged to determine the evaluation areas (step 21).
Within the photographic image plane of the electronic camera 10, five areas (g)-(k) where focal point detection is possible are set in advance as shown in FIG. 5B. The photographer can select a desired focal point detection area is from the areas (g)-(k) by operating the operating button group 27. Alternatively, the microprocessor 18 may identify the area where the closest subject is located based upon the focal point detection data corresponding to the individual areas to automatically select the area as a focal point detection area. Furthermore, the focal point detection area may be changed in conformance to the movement of a moving subject by adopting the focal point detection technology of the known art. The microprocessor 18 sets an evaluation area at the current position of the focal point detection area selected in this manner (step S22).
First, the microprocessor 18 ascertains the switching state at the operating button group 27 and makes a decision as to whether or not an operation for locking the focal adjustment (so-called AF lock) has been performed by the photographer (step S30). If AF lock has not been implemented, the microprocessor 18 sets the area selected for focal point detection as an evaluation area (step S31).
If, on the other hand, AF lock has been implemented, it is likely that the photographer wishes to change the framing in order to change the image composition. For this reason, the microprocessor 18 clears the current evaluation area setting (step S32). Next, the microprocessor 18 ascertains the switching state at the operating button group 27 to make a decision as to whether or not an operation for locking the exposure adjustment (so-called AE lock) has been performed by the photographer (step S33).
At this point, if AE lock has been implemented, it is likely that the photographer wishes to change the framing in order to change the image composition. For this reason, the microprocessor 18 does not set an evaluation area range at this point and instead, resets the entire image plane as the evaluation area (stop S34). If, on the other hand, AE lock has not been implemented, the microprocessor 18 sets the area selected for photometry as the evaluation area (steps S35-S39).
Next, the image-capturing stop condition decision-making routine is explained. FIG. 6 illustrates the image-capturing stop condition decision-making routine. When this decision-making routine is started up from the main routine, the microprocessor 18 first identifies the mode setting for the number of frames for image-capturing (step S41). At this point, if the fixed frame number mode has been selected by the photographer, the microprocessor 18 makes a decision as to whether or not the photographer has intentionally selected the acceptability selection mode (step S42). When the acceptability selection mode has been selected on purpose, the photographer will not sense anything amiss even if the number of frames for image-capturing is large. For this reason, the microprocessor 18 sets the number of frames for image-capturing at a relatively large value (10 frames in this example) (step S43).
Next, the acceptability evaluation routine is explained. FIG. 7 shows the acceptability evaluation routine executed by the microprocessor 18. Initially, when the acceptability evaluation routine is started up from the main routine, the microprocessor 18 selects one set of image data that has not been evaluated yet and extracts the data included in the image data that correspond to an evaluation area (step S60). The microprocessor 18 processes the data within the evaluation area thus extracted through the following procedure by employing the image compression unit 17 (step S61).
If, on the other hand, there are a plurality of evaluation areas, the microprocessor 18 executes (1) weighted addition, (2) majority operation, (3) maximum value operation, (4) minimum value operation or the like on the evaluation values corresponding to the individual evaluation areas to determine an integrated evaluation value (stop S64). This sequence of processing is implemented for all the image data having undergone image-capturing (step S65).
The following is an explanation of the selection screen display routine. FIG. 8 is a flowchart of the selection screen display routine executed by the microprocessor 18. First, when the image selection display routine is started up from the main routine, the microprocessor 18 makes a decision with regard to the mode setting for screen display (step S71).
At this point, if the photographing order display mode has been selected by the photographer, the microprocessor 18 brings up a thumbnail display of image data in the order in which they were photographed on the display unit 25 via the image display circuit 24 (step S72). If, on the other hand, the evaluation rank order display mode has been selected by the photographer, the microprocessor 18 brings up a thumbnail display of image data in the order of evaluation ranks on the display unit 25 via the image display circuit 24 (step S73).
In addition, FIG. 9B presents a selection screen that may be displayed in the evaluation rank order display mode. In this selection screen, the image data ranked the highest in the evaluation have been obtained through inopportune shutter timing with the subject's eyes partially closed. In this situation, the photographer may take into consideration both the shutter timing and the evaluation ranks to make a selection of a good image, e.g., the image data ranked third in the evaluation.
(1) Image data with a high content of the high spatial frequency component can be selected and recorded from image data obtained through continuous image-capturing. Consequently, image data that contain reduced degrees of camera vibration blur, subject-motion blur and poor focus as a whole can be selectively obtained. (2) Since acceptability evaluation is performed on image data within an evaluation area that only partially occupies the entire image plane, an accurate acceptability evaluation of the image data can be achieved while the degree to which blurring in the background image and the like affects the overall evaluation can be minimized. Furthermore, since the acceptability evaluation is not performed on the entire image plane, the length of time required for the acceptability evaluation processing can be reduced. (3) Since the evaluation weighting is set lower toward the periphery of the evaluation area compared to the evaluation weighting set for the central portion of the evaluation area, the acceptability evaluation value is not caused to fluctuate greatly by an image that accidentally jumps into the evaluation area. (4) Since a plurality of evaluation areas can be evaluated in an integrated manner, a correct acceptability evaluation can be executed even when there are a plurality of subjects present within the image plane. (5) An evaluation area can be set by excluding the light areas and the dark areas within the image plane. As a result, it is possible to avoid making an inappropriately low evaluation due to a brightness collapse or the like to execute a correct acceptability evaluation by focusing the attention on the subject. (6) Since a focus-verified area can be set as an evaluation area, a correct acceptability evaluation can be executed for the image of a subject present within the image plane at a position corresponding to the focus-verified area. (7) A photometric area or a focal point detection area may be set as an evaluation area. Consequently, a setting device for the photometric area or the focal point detection area may be utilized for setting the evaluation area, thereby making it possible to further simplify that portion of the structure of the electronic camera 10 engaged in setting these areas. (8) Since the evaluation area setting can be automatically cleared if the photographer fixes the focal adjustment or the exposure adjustment, any reduction in the reliability of the acceptability evaluation which may be caused by a change in the image plane composition can be prevented. (9) The number of frames for continuous image-capturing can be varied in a flexible manner during the image-capturing stop condition decision-making routine. (10) Since a continuous image-capturing operation can be stopped immediately by detecting a change in the framing, problems of wastefully sustaining a continuous image-capturing operation after a change occurs in the framing and the like can be prevented. (11) If none of the evaluations on the image data achieve a value equal to or higher than the threshold value, the continuous image-capturing operation is resumed. As a result, there is no risk of an acceptability selection being executed on image data with evaluation values lower than the threshold value so that storage of image data that achieve a value at least equal to or higher than the threshold value is assured. (12) The photographer can correctly select and store image data obtained in a good photographing state via a selection screen. During the process of selection, the photographer can select image data by referring to the results of the acceptability evaluation and also taking into consideration subjective criteria such as shutter timing. Second Embodiment While acceptability evaluation is performed in a batch after taking in a plurality of sets of image data in the first embodiment, the electronic camera in the second embodiment performs image-capturing and acceptability evaluation on a single set of image data at a time. It is to be noted that since the structural features of the second embodiment are identical to those in the first embodiment (see FIG. 1) except for the operating program executed by the microprocessor 18, explanation of the structural features is omitted.
If, on the other hand, the change in the acceptability evaluation results relative to the previous results indicates a value smaller than the threshold value, the microprocessor 18 decides that no change in the framing has occurred (step S106 NO). In this situation, the microprocessor 18 continues continuous image-capturing by shifting its operation to step S107. It is to be noted that it is desirable to set an area where the image composition changes greatly (e.g., the periphery of the photographic image plane) as a framing change detection area. The difference in the image data among individual frames, fluctuations in the acceptability evaluation results or the like within the detection area can be monitored by the microprocessor 18 to promptly detect a framing change.
Next, the microprocessor 18 makes a decision as to whether or not the results of the acceptability evaluation have exceeded a relative maximum point (step S110). If it is decided that the acceptability evaluation results have not exceeded the relative maximum point (step S110 NO), it can be decided that the acceptability evaluation an the image data is likely to improve further. Thus, the microprocessor 18 returns to the operation in step S103 and continuous with the continuous image-capturing operation.
FIG. 14 illustrates the image overwrite recording routine. First, when the image overwrite recording routine is started up from the main routine, the microprocessor 18 makes a decision as to whether or not the entire image plane is set as the evaluation area (step S120). If it is decided that only a portion of the image plane has been set as the evaluation is area (step S120 NO), the microprocessor 18 shifts its operation to step S123 to perform image compression anew for the entire image plane.
Next, the microprocessor 18 performs image compression again on the current set of image data by using the estimated compression parameter (step S124). The microprocessor 18 then makes a decision as to whether or not the post-compression code volume thus obtained is within the allowable range for the target post-compression code volume for recording (step S125). At this point, if it is decided that the post-compression code volume is not within the allowable range for the target compression ratio for recording (stop S125 NO), the microprocessor 18 re-estimates the compression parameter (step S126) before returning to the operation in step S124.
(1) It is possible to select and record image data with a high content of the high spatial frequency component among image data obtained through continuous image-capturing. Thus, image data with lesser degrees of camera vibration blur, subject-motion blur, poor focus and the like can be obtained with a high degree of reliability. (2) In particular, since acceptability evaluation is executed concurrently during continuous image-capturing, a decision can be made as to whether or not a continuous image-capturing operation is to be stopped in correspondence to the results of the acceptability evaluation. Thus, automatic adjustment of the number of frames can be achieved with a high degree of accuracy, to efficiently avoid problems of the number of frames set too low to result in only images ranked low in evaluation being captured, the number of frames set too high to allow the photographing period to be prolonged meaninglessly and the like. (3) Since the image compression unit 17 is utilized to execute both the image compression for acceptability evaluation and the image compression for recording, it is not necessary to provide a separate processing mechanism for acceptability evaluation, thereby achieving simplification in the structure of the electronic camera 10. (4) A special compression parameter that is independent of the compression parameter for recording is used when executing the image compression for acceptability evaluation. As a result, the image compression can be performed at a compression ratio in the medium range, which is suitable for acceptability evaluation to achieve an accurate acceptability evaluation, regardless of the compression ratio set for recording. (5) If the code volume of the compressed data for acceptability evaluation is determined to be suitable for recording, the compressed data are stored without further processing. Thus, it becomes possible to omit the re-compression processing for recording to effectively reduce the length of processing time. (6) Since the results of compression performed for acceptability evaluation are regarded as a trial compression, the number of trial compressions that need to be performed during recording can be reduced with a high degree of efficiency. (7) Since the results of the acceptability evaluation are displayed within the finder, the photographer can refer to the finder display to achieve a better photographing state for subsequent photographing operations (8) since the current highest evaluation value and the latest evaluation value are displayed on the monitor, the photographer is able to achieve a better photographing state for subsequent photographing operations by using the highest evaluation value as a target. Third Embodiment In the third embodiment, a program in a recording medium is used to constitute an image selection system on a computer. FIG. 15 illustrates the configuration of an image selection system achieved by employing a computer 71.
The microprocessor 72 is also connected with a CD ROM drive device 80. A CD ROM 81 having an image processing program and an installation program for installing the image processing program recorded therein is inserted at the CD ROM drive device 80. Using the installation program in the CD ROM 81, the microprocessor 72 reads the image processing program in the CD ROM 81 and stores it in the hard disk 74 in an execution-enabled state.
It is to be noted that if the computer 71 is connected with an electronic camera or the like and information pertaining to image-capturing (information such as the photometric area, the focal point detection area, whether or not an AE lock is in effect, whether or not an AF lock is in effect, the photometric value and the focus-verified area) is available, any of the setting routines presented in FIG. 3A-3D and FIG. 4 illustrating the first embodiment can be executed. If, on the other hand, such information pertaining to image-capturing cannot be obtained, evaluation area range setting by the user may be accepted via the input device 73, such as a mouse.
In addition, by executing the setting routine presented in FIG. 17, an evaluation area can be automatically set. In FIG. 17, the microprocessor 72 first takes in the brightness information in the image data. Based upon the brightness information, the microprocessor 72 excludes extremely light areas and extremely dark areas in the image plane and creates an appropriate exposure area (step S210). Next, the microprocessor 72 sets this appropriate exposure area as an evaluation area (step S211). After executing one of the setting routines described earlier, the microprocessor 72 executes the acceptability evaluation routine (FIG. 7) explained earlier in reference to the first embodiment to sequentially execute acceptability evaluation on the plurality of sets of image data (Step S7).
Next, the microprocessor 18 makes a decision with regard to the conditions set by the user and determines whether or not a good image is to be selected on the screen (step S203). At this point, if the user has already selected the operating conditions for selecting an image on the screen (step S203 YES) the microprocessor 18 executes the selection screen display routine (see FIG. 8) explained earlier in reference to the first embodiment and brings up the �thumbnail display of image data obtained through continuous image-capturing� and the �rankings in the acceptability evaluation� overlapping each other on the monitor 77 (step S10).
The user manually selects one set of the image data on the monitor 77 as a good image by, for instance, operating the input device 73 (step S205). After accepting the manual selection of the good image, the microprocessor 18 shifts its operation to step S207. If, on the other hand, it is decided in step S203 that the setting conditions for automatically selecting an image have been selected (step S203 NO), the microprocessor 18 selects the set of image data ranked first in the acceptability evaluation as a good image (step S206).
(Additional Notes on the Embodiments)
It is to be noted that while continuous image-capturing operation is stopped at a point in time at which an evaluation value exceeds the relative maximum point (step S110) in the second embodiment, the present invention is not restricted to this example. For instance, the continuous image-capturing operation may be stopped based upon a decision that a sufficiently good image has been captured at a point in time at which an evaluation value has exceeded a specific upper limit value. Alternatively, the continuous image-capturing operation may be stopped based upon a decision that further continuation of the continuous image-capturing operation is meaningless at a point in time at which an evaluation value has become equal to or less than a specific lover limit value. Or, continuous image-capturing may be stopped at a point in time at which the number of frames in which images have been captured has exceeded a specific value.
In addition, the first embodiment, in which the image is selection is executed after a continuous image-capturing operation is completed, achieves an advantage in that a continuous image-capturing operation can be performed at high speed. The second embodiment, in which image selection and overwrite storage are executed on a single image at a time while a continuous image-capturing operation is in progress, on the other hand, achieves an advance in that it is not necessary to temporarily store all the image data. Thus, an operation switching device may be provided to make a decision as to whether or not there is sufficient temporary storage capacity so that the high speed continuous image-capturing in the first embodiment is executed when there is a comfortable margin in terms of temporary storage capacity, whereas the second embodiment is adopted if there is no comfortable margin to ensure that temporary storage capacity is always available. Through such an operation of the operation switching device, the acceptability selection mode can be switched in a flexible manner for execution in correspondence to the number of remaining frames at the electronic camera and the like.
Fourth Embodiment The following is an explanation of the fourth embodiment, given in reference to FIGS. 18 and 19. FIG. 18 is a block diagram illustrating the structure of an electronic camera 111. FIG. 19 is an external view of the electronic camera 111 illustrating the positions of its operating members.
FIG. 20 is a flowchart of the operation performed by the microprocessor 114. First, the microprocessor 114 takes in an external mode selection operation performed by the photographer via the selector button group 124 and the command dial 123. The external operation performed at this point may be one of the following (D1)-(D3) below, for instance.
FIG. 21 is a state transition diagram illustrating in detail the mode setting changes effected through this process. As illustrated in FIG. 21, there are 8 different types of mode states P1-P8 listed below depending upon how the three types of modes (light emission mode, continuous shooting mode, acceptability selection mode) are combined.
P1 normal mode (non-light emission mode and single shot mode and non-acceptability selection mode) P2 light emission mode P3 continuous shooting mode P4 acceptability selection mode P5 light emission mode, continuous shooting mode P6 acceptability selection mode, light emission mode, continuous shooting mode P7 acceptability selection mode, light emission mode P8 acceptability selection mode, continuous shooting mode In the mode states P1-P4, no problems attributable to a plurality of modes used at the same time occur. Thus, the microprocessor 114 directly accepts an external mode selection operation performed by the photographer to change the mode within the range of the states P1-P4 and executes a mode setting change (the state transitions marked with circles in FIG. 21). At this point, the microprocessor 114 notifies the photographer that a mode setting change has been executed through mode display on the display unit 25.
In the other mode states P5-P8, on the other hand, at least two modes among the three types of modes (the light emission mode, the continuous shooting mode, the acceptability selection mode) may be set concurrently and problems attributable to using a plurality of modes at the same time are expected to occur. In order to prevent these problems, the microprocessor 114 does not accept any external mode selection operation that would cause a transition to any of the states P5-P8 (the state transitions marked with crosses in FIG. 21). At this time, the microprocessor 114 issues a warning indicating that the mode change is not accepted via the display unit 125, a buzzer or the like. The microprocessor 114 repeatedly executes the series of setting operations described above until the shutter release button 122 is pressed (FIG. 20, S301 NO).
Fifth Embodiment Since the structure and the photographing sequences of the fifth embodiment are identical to those of the fourth embodiment (see FIG. 18 and FIG. 20), their explanation is omitted.
FIG. 22 is a state transition diagram illustrating mode setting changes effected by the microprocessor 114. It is to be noted that the illustration of the state transitions occurring between the continuous shooting mode and the light emission mode are omitted in FIG. 22 to simplify the explanation of the invention. As illustrated in FIG. 22, flags F1-F3 for storing the mode history are provided in advance on the internal memory of the microprocessor 114. When one of the flags F1-F3 is set, it indicates the following mode history.
F1: The continuous shooting made has been previously cleared automatically F2: The light emission mode has been previously cleared automatically F3: The acceptability selection mode has been previously cleared automatically The following is an explanation of specific mode setting change operations performed in specific situations (E1)-(E8).
In the state in which the normal mode is selected, the microprocessor 114 resets the flags F1-F3 to erase the past mode history. If the photographer performs a setting operation to select any one of the light emission mode, the continuous shooting mode and the acceptability selection mode while the normal mode is set, the microprocessor 114 effects a setting change to shift to the desired mode.
If the photographer performs a setting operation to select the light emission mode while the acceptability selection mode is set, the microprocessor 114 automatically clears the acceptability selection mode that is currently selected and then effects a setting change to select the light emission mode. Concurrently with such a setting change, the microprocessor 114 sets the flag F3 and stores the �automatic is clearing of the acceptability selection mode.� In addition, the microprocessor 114 resets the other flags F1 and F2 to erase other unnecessary mode histories.
If the photographer performs a setting operation to select the acceptability selection mode while the continuous shooting mode is set, the microprocessor 114 automatically clears the continuous shooting mode that is currently selected and then effects a setting change to select the acceptability selection mode. Concurrently with such a setting change, the microprocessor 114 sets the flag F1 to store the �automatic clearing of the continuous shooting mode.� In addition, the microprocessor 114 resets the other flags F2 and F3 to erase other unnecessary mode histories.
If the photographer performs an operation to clear the continuous shooting mode while the continuous shooting mode is set, the microprocessor 114 makes a decision with regard to the state of the flag F3. At this point, if the flag F3 is determined to be in a reset state, the microprocessor 114 clears the continuous shooting mode and effects a setting change to select the normal mode. If, on the other hand, the flag F3 is determined to be in a set state, the microprocessor 114 clears the continuous shooting mode and resets the flag F3 before effecting a setting change (recovery) to select the acceptability selection mode.
If the photographer performs a setting operation to select the acceptability selection mode while the light emission mode is set, the microprocessor 114 automatically clears the light emission mode that is currently selected and then effects a setting change to select the acceptability selection mode. Concurrently with such a setting change, the microprocessor 114 sets the flag F2 to store the �automatic clearing of the light emission mode.� In addition, the microprocessor 114 resets the other flags F1 and F3 to erase other unnecessary mode histories.
If the photographer performs an operation to clear the light emission mode while the light emission mode is set, the microprocessor 114 makes a decision with regard to the state of the flag F3. At this point, if the flag p3 is determined to be in a reset state, the microprocessor 114 clears the light emission mode and effects a setting change to select the normal mode. If, on the other hand, the flag F3 is determined to be in a set state, the microprocessor 114 clears the light emission mode and resets the flag F3 before effecting a setting change (recovery) to select the acceptability selection mode.
In the fifth embodiment, too, by performing the operations described above, the acceptability selection mode, the continuous shooting mode and the light emission mode can be prevented from being used at the same time with a high degree of reliability. Thus, any problems attributable to these modes being set concurrently can be prevented.
Sixth Embodiment Since the structure of the sixth embodiment is identical to that adopted in the fourth embodiment (see FIG. 18) except for the internal program at the microprocessor 114, the explanation of its structural features is omitted.
If, on the other hand, the non-light emission mode is currently set, the microprocessor 114 makes a decision as to whether or not the acceptability selection mode is currently set (FIG. 23, S406). If it is decided that the non-acceptability selection mode is currently set, the microprocessor 114 executes a photographing operation in the normal mode (FIG. 23, S407). If the acceptability selection mode is currently set, the microprocessor 114 executes a photographing operation in the acceptability selection mode (FIG. 23, S408-S410). After completing the photographing sequence corresponding to a given mode as described above once, the microprocessor 114 returns to the operation in step S400.
FIG. 24 illustrates a configuration through which the program is provided in this manner. An electronic camera 201 is constituted of separate units, i.e., an image-capturing unit 202 and an information processing unit 203, as described above. The information processing unit 203, which is provided with a CD ROM drive device, is capable of receiving programs provided on a CD RON. In addition, the information processing unit 203, which has a function of connecting with a telecommunication line 205, is capable of receiving programs provided via the internet or the like. The programs described above are stored in a computer 206, which functions as a server computer. i.e., the provider of the program. The telecommunication line 205 may be a telecommunication line for an internet connection, telecomputing service or the like or a dedicated telecommunication line. The telecommunication line 205 may be a telephone line, a wireless telephone line, a mobile telephone line or the like. In addition, the program executed by the computer 71 in FIG. 15 illustrating the third embodiment, too, may be provided through the internet or the like.
Patent CitationsCited PatentFiling datePublication dateApplicantTitleUS5043816Dec 20, 1989Aug 27, 1991Casio Computer Co., Ltd.Electronic still camera including photographing timing controlUS5111306Apr 16, 1991May 5, 1992Olympus Optical Co., Ltd.Endoscope image filing systemUS5359382Jul 13, 1993Oct 25, 1994Asahi Kogaku Kogyo Kabushiki KaishaAutomatic focusing deviceUS5359676Jul 19, 1993Oct 25, 1994Xerox CorporationDecompression of standard ADCT-compressed document imagesUS5479211Apr 29, 1993Dec 26, 1995Olympus Optical Co., Ltd.Image-signal decoding apparatusUS5539426 *Apr 21, 1994Jul 23, 1996Kabushiki Kaisha ToshibaImage display systemUS5594554Oct 4, 1993Jan 14, 1997Zoran CorporationImage compression coder having improved scale factor controlUS5729363 *Jul 18, 1994Mar 17, 1998Sony CorporationImaging parameter recording apparatus, imaging method and editing systemUS5842059Jul 17, 1997Nov 24, 1998Canon Kabushiki KaishaAutomatic focus adjusting deviceUS6125201Jun 25, 1997Sep 26, 2000Andrew Michael ZadorMethod, apparatus and system for compressing dataUS6333752 *Mar 12, 1999Dec 25, 2001Ricoh Company, Ltd.Image processing apparatus, image processing method, and a computer-readable storage medium containing a computer program for image processing recorded thereonUS6415057Apr 3, 1996Jul 2, 2002Sony CorporationMethod and apparatus for selective control of degree of picture compressionUS6697529Oct 5, 1999Feb 24, 2004Nikon CorporationData compression method and recording medium with data compression program recorded thereinUS7027087Sep 8, 1998Apr 11, 2006Nikon CorporationElectronic cameraJPH1131239A * Title not availableJPH04220879A Title not availableJPH11136557A Title not available* Cited by examinerReferenced byCiting PatentFiling datePublication dateApplicantTitleUS8400528 *Feb 12, 2009Mar 19, 2013Panasonic CorporationImaging deviceUS8644643 *Jun 14, 2006Feb 4, 2014Qualcomm IncorporatedConvolution filtering in a graphics processorUS8766995Apr 26, 2006Jul 1, 2014Qualcomm IncorporatedGraphics system with configurable cachesUS8766996Jun 21, 2006Jul 1, 2014Qualcomm IncorporatedUnified virtual addressed register fileUS8810686 *Mar 20, 2012Aug 19, 2014Mediatek Inc.Method, device, and machine readable medium for image capture and selectionUS20070292047 *Jun 14, 2006Dec 20, 2007Guofang JiaoConvolution filtering in a graphics processorUS20090207279 *Feb 12, 2009Aug 20, 2009Panasonic CorporationImaging deviceUS20100289929 *Mar 13, 2009Nov 18, 2010Canon Kabushiki KaishaImage pickup apparatus and control method therefor* Cited by examinerClassifications U.S. Classification358/2.1, 382/275, 382/254International ClassificationH04N5/232, H04N5/235, H04N1/40Cooperative ClassificationH04N5/2351, H04N5/23222, H04N5/235, H04N5/2354, H04N5/232, H04N5/23293European ClassificationH04N5/232J, H04N5/232V, H04N5/232, H04N5/235L, H04N5/235, H04N5/235BLegal EventsDateCodeEventDescriptionApr 2, 2014FPAYFee paymentYear of fee payment: 4RotateOriginal ImageGoogle Home - Sitemap - USPTO Bulk Downloads - Privacy Policy - Terms of Service - About Google Patents - Send FeedbackData provided by IFI CLAIMS Patent Services©2012 Google