Still image sensing apparatus

Abstract: A still image sensing apparatus comprising an image sensor, a memory circuit for writing therein the video signal for one field or one frame from the image sensor, a detecting circuit for detecting the color temperature information of a light source related to an object being photographed on the basis of the aforesaid video signal, and a control circuit receptive of an output of the detecting circuit for controlling the white balance of a video signal read from the memory circuit.

Description: In the white balance control of the still image sensing apparatus, it has been the typical practice that, besides the image sensor, there is provided a colorimetric sensor for detecting the color temperature information of the light source. Based on the output of this sensor, the video signals output from the image sensor are controlled so as to obtain good white balance. However, the above-described conventional method not only necessitates the use of the colorimetric sensor, but also cannot make accurate white balance control when the color temperature of the light source at which the colorimetric sensor aims differs from that of a virtual light source which is illuminating an object being photographed. Another problem of the prior known method is that the so-called release time lag gets longer, because the time space necessary to detect the color temperature information and then make preparation for the white balance control up to its completion must fall within the interval from the depression of the shutter button to the initiation of an actual exposure. In this case, it often happens that the real color temperature information differs from the measured one at the time of colorimetry. The present invention aims at eliminating such problems, and providing a still image sensing apparatus which does not necessitate a colorimetric sensor, while nevertheless enabling accurate white balance to be performed, and whose release time lag is minimized. JP-A-63-131680 discloses apparatus to effect adjustment of white balance, by calculating a color image pickup signal stored in a storage means, and generating a white balance correcting data from a gain control data for white balance correction for each primary color signal consisting of the color image pickup signal. According to the invention there is provided a still image sensing apparatus having the features of claim 1. Further according to the invention there is provided a method having the operational features of claim 7. Other aims and features of the invention will become apparent from the following description of the specification. In the accompanying drawings:- Fig. 1 is a block diagram of the outline of a first embodiment of the invention. Fig. 2 is a block diagram of the same embodiment. Fig. 3 is a block diagram of an arrangement not in accordance with the invention. Fig. 4 is a flowchart briefly illustrating the operation of the embodiment. Fig. 5 is a block diagram of the outline of an arrangement not in accordance with the invention. Fig.6 is a timing chart illustrating a manner in which the apparatus of Fig. 5 and Fig. 9 operates. Fig. 7 is a block diagram of the arrangement shown in Fig. 5. Figs. 8(a), 8(b) and 8 (c) are plan views of other examples for the purpose of reference only. Fig. 9 is a block diagram of the outline of an arangement not in accordance with the invention. Fig. 10 is a flowchart briefly illustrating the operation of the arrangement shown in Fig. 9. Fig. 1 in block diagram schematically shows a first embodiment of a still image sensing apparatus, comprising an image sensor 1, a signal processing circuit 2 for processing a video signal output from the image sensor 1, a memory 3 (storing means) for temporarily storing the processed still video signal for one field or one frame, a detecting circuit 4 for detecting color temperature information of a light source illuminating an object being photographed or a light source which is an object being photographed (hereinafter called the "light source related to the object") on the basis of the video signal output from the signal processing circuit 2, a computing circuit 5 (white balance control means) for controlling white balance of the video signal output from the memory 3, and a system controller 6 using a microcomputer or the like for controlling the operations of the entirety of the system including the reading and writing operations in the aforesaid memory 3 and the color temperature information detecting circuit 4. The white balance control is explained by using Fig. 2 showing the block diagram of the details of the above-described circuitry. In the figure, an image sensor 1 and a signal processing circuit 2 have the same functions as those of the blocks of Fig. 1 which are denoted by the same reference numerals. In the image sensor 1, a field or a frame of an image is converted into R, G and B video signals, which are then treated in the signal processing circuit 2. The outputs R, G and B of the circuit 2 are supplied respectively to A/D converters 11, 12 and 13 and therefrom to field or frame memories 14, 15 and 16. The gains of the R and B video signals output from the memories 14 and 16 are controlled by computing circuits 17 and 18, respectively. Matrix computing circuits 19 and 20 produce color-difference signals R-Y and B-Y respectively. Integrators 21 and 22 integrate the R-Y and B-Y signals, respectively. A/D converters 23 and 24 convert the outputs of the integrators 21 and 22 into digital data form respectively. Based on the data of the A/D converters 23 and 24, a microcomputer 25 selects control amounts from a table of a gain control data ROM 26 so as to obtain correct white balance. Signals representing the selected control amounts are supplied to the gain control computing circuits 17 and 18. That the correct white balance can be obtained by the white balance control circuit of such a construction (19 to 26: color temperature information detecting circuit 4) is described in detail in Japanese Laid-Open Patent Application No. Sho 63-300688 or others. So, it is no longer explained here. In such a manner, the signal to be used in the white balance control is formed from the video signal from the image sensor. Accordingly, the color temperature information of the light source related to the object being photographed can be grasped without error, thus providing a possibility of making an accurate white balance control. Also since, as the video signals to be subjected to white balance treatment are stored in the field (frame) memories 14 to 16, time to spare is afforded, sufficient examination on selection of data for the accurate white balance control is possible. Hence, the accurate white balance control can be effected. The blocks 19 to 26 in Fig. 2 correspond-to the detecting means for detecting the color temperature information of the light source related to the object being photographed in the present embodiment, and the blocks 17 and 18 correspond to the control means for controlling the white balance in the present embodiment. The above-described operation of the embodiment can, though in short, otherwise be shown by a flowchart of Fig. 4, where the output of the image sensor 1 after having been processed is first written in the memory 3 (step 1) and, at the same time, the output of the signal processing circuit 2 is supplied to the color temperature information detecting circuit 4, so that the white balance control signal is formed (step 2). Then, the signal written in the memory 3 is read out and, for these signals, the white balance is controlled based on the aforesaid white balance control signal (step 3). It is to be noted that such coordinations are controlled by the before-described system controller 6. Fig. 3 shows an image sensor 1, a signal processing circuit 2, A/D converters 11, 12 and 13, field (frame) memories 14, 15 and 16 and gain control computing circuits 17 and 18 are of the s-ame functions as those of the parts of Fig. 2 which are denoted by the same reference numerals. To obtain the white balance control signal, in this arrangement the outputs of the field memories 14, 15 and 16, or the R, G and B digital video signals, are used. Digital matrix computing circuits 31 and 32 produce color-difference signals R-Y and B-Y, respectively. These color-difference signals are integrated by integrators 33 and 34. Based on the color-difference signal integration data formed by the integrators 33 and 34, a microcomputer 35 selects, from a table of a gain control data ROM 36, control amounts to obtain the correct white balance. The selected control amounts are supplied to the gain control computing circuits 17 and 18. Since the output signals of the field (frame) memories 14, 15 and 16 are used as the signals detected to control the white balance, sufficient examination for selection of control data for the correct white balance is possible and it is also possible to recycle the reading of the memories 14, 15 and 16 any number of times to correct the control data for the white balance. In another arrangement, instead of the feed-forward control on the white balance in the above-described arrangement, a feedback control on the white balance is made by using the output signals of the gain control computing circuits 17 and 18 and the field (frame) memory 15 as the feedback signals, thereby giving an advantage of increasing the accuracy of white balance control. As has been described above, the video signal output from the image sensor is stored in the memory means and, by using the video signal output from the image sensor, the control signal for white balance is formed. This enables an accurate white balance control to be made, and the release time lag to be minimized. Fig. 5 in block diagram schematically shows an image sensor 41, a signal processing circuit 42 for processing a video signal output from the image sensor 41, a detecting circuit 43 (detecting means) for detecting color temperature information of a light source illuminating an object being photographed or a light source that is the object (hereinafter called the "light source related to the object) on the basis of the video signal output from the signal processing circuit 42, a gain control circuit (control means) for controlling the white balance, a system controller 45 for controlling the coordinations of the aforesaid image sensor 41, color temperature information detecting circuit 43 and others, and an optical system 47 having a focusing means and a zooming means. The operation of the apparatus of such a construction is described by using the timing chart of Fig. 6. The image sensor 41 is first exposed to an object image for a first reading for a time t 1 -t 2 of Fig. 6 and then the video signal is read out for another time t 3 -t 4 . This first read signal passes through the signal processing circuit 42 and therefrom is supplied to the color temperature information detecting circuit 43. Over an extended time t 3 -t 5 , the color temperature information is detected and the gain control value for white balance control is computed. And, for a time t 6 -t 7 . another exposure for a second reading from the image sensor 41 is made while being controlled by the system controller 45. The second reading is effected for a time t 8 -t 9 . This second read signal is subjected to gain control in the white balance gain control circuit 44 by the output of the color temperature information detecting circuit 43 which is produced while being controlled by the system controller 45. Concerning the above-described arrangement of the color temperature information detecting circuit 43 and the white balance gain control circuit 44, explanation is given by using Fig. 7. In Fig. 7, an image sensor 41 and a signal processing circuit 42 are of the same functions as those of the blocks of Fig. 5 which are denoted by the same reference numerals. One field or one frame of image is photoelectrically converted by the image sensor 41 into R, G and B video signals, which are then processed in the signal processing circuit 42. Matrix computing circuits 51 and 52 convert the R, G and B outputs of the signal processing circuit 42 into color-difference signals R-Y and B-Y, respectively. Integrators 53 and 54 integrate the color-difference signals R-Y and B-Y, respectively. A/D converters 55 and 56 convert the outputs of the integrators 53 and 54 into digital data. Reference numerals 57 and 58 denote a microcomputer and a gain control data ROM, respectively, and reference numerals 59 and 60 denote gain control circuits. Based on the data of the A/D converters 55 and 56, the microcomputer 57 selects the control amounts from the table of the gain control data ROM 58 to obtain the correct white balance, so that the control amounts are supplied to the gain control computing circuits 59 and 60 in a predetermined timing controlled by the system controller 45. In the gain control circuits 59 and 60, the gains of the R and B signals are controlled respectively. Thus, the R, G and B output signals that have a correct white balance are obtained. The blocks 51 to 58 of this practical example correspond to the detecting means and the blocks 59 and 60 correspond to the control means. Since the correct white balance can be obtained by the circuit (51 to 58: the color temperature information detecting circuit 43) for white balance control of the construction described above is described in detail in the Japanese Laid-Open Patent Application No. Sho 63-300688, no more explanation is given here. Fig. 10 shows a flowchart summarizing the operation of the arrangement, wherein the image sensor 41 is first read for the first reading (step 1), and, from this output, a white balance control signal is formed (step 2). Then, a second reading is carried out (step 3), and, for this output, the white balance control is carried out by using the white balance control signal (step 4). Zooming of the zoom lens for forming an optical image on the image sensor 41 is set to, and maintained in, the wide-angle state for the time t 1 -t 2 of Fig. 6 with the result that a particular object does not affect making of the color temperature information of the light source related to the object from the image signal. In this manner the influence of a particular color, for example, the color of the object itself, can be substantially reduced, thereby making it possible to make a more accurate white balance control. In an alternative arrangement mentioned for reference only, a light diffusing plate of the movable type may be arranged to be inserted into and withdrawn from the optical path to the image sensor 41 at, for example, the front of the image sensor, so that, for the time t 1 -t 2 of Fig. 6, the light passing through the diffusing plate enters the image sensor, thus increasing the accuracy of the light source color temperature information. In another arrangement described for reference purposes only, the first reading may be operated with selection of a mode in which, of the video signal for one field or one frame, only a central portion of the picture is used for colorimetry with an emphasis as shown in Fig. 8(a), another mode in which only a part of the picture is used for colorimetry as shown in Fig. 8(b), and still another mode in which every other scanning line is skipped when reading for colorimetric purpose as shown in Fig. 8(c), thereby giving an advantage of providing a possibility of selecting the suitable one of the conditions to obtain the color temperature information of the light source related to the object. Another advantage arising from the use of the skipping method is that a shortening of the reading time becomes possible. In Fig. 9, reference numerals 41 to 44 denote parts of the same functions as those of the circuit blocks of Fig. 5 which are denoted by the same reference numerals. A field or frame memory 46 stores the video signal output from the signal processing circuit 42. In the above-described arrangement, the video signal obtained by the first reading for the period t 3 -t 4 of Fig. 6 is stored in the field or frame memory 46. After that, the video signal stored in the field or frame memory 46 is read to be supplied to the color temperature information detecting circuit 43, where the color temperature information of the light source related to the object is detected. After this, as a second exposure is carried out, the white balance control is carried out. The field or frame memory 46 is so arranged that the reading of its video signal can be repeated any number of times. Hence, it is made possible to increase the accuracy of gain control for white balance when it is computed by the color temperature information detecting circuit 43. The invention enables the white balance control to be made without the necessity of using a colorimetric sensor. Also, because of using no colorimetric sensor, only the color temperature information of the light source related to the object can be detected. This enables the white balance to be controlled with high accuracy. Also by means of the invention the influence of the color of the object itself on the white balance control is minimised.

Claims: A still image sensing apparatus comprising image sensing means (1) for producing a video signal representing an object being photographed, memory means (14, 15, 16) for storing the video signal output from said image sensing means, detecting means (4) for detecting the color temperature of a light source related to the object being photographed on the basis of the video signal output by the sensing means, and white balance control means (5) adapted to receive the output of said detecting means for controlling the white balance of said video signal read from said memory means, characterised in that the memory means (14, 15, 16) and detecting means (4) are arranged to receive simultaneously the video signal output by the sensing means to enable the detecting means (4) to detect the color temperature of said light source on the basis of said video signal while said video signal is stored in said memory means. An apparatus as claimed in claim 1, characterised in that said detecting means (4) has further memory means for storing white balance control data. An apparatus as claimed in claim 2, characterised in that said further memory means of said detecting means includes a ROM (58). An apparatus as claimed in any one of claims 1-3, characterised in that said memory means has a storage capacity of one field or one frame. An apparatus as claimed in any one of claims 1-4, characterised in that said data reading means is adapted to repeat the reading of the data representing said one piece of still video picture. A still image sensing method comprising the steps of writing in memory means a video signal representing an object being photographed output from image sensing means, detecting the color temperature of a light source related to the object being photographed on the basis of the video signal, reading the video signal from said memory means when the detection has been completed, and carrying out a white balance correction for the read video signal in accordance with the result of the detection, characterised by detecting the color temperature information of said light source on the basis of said video signal at the same time as the video signal is written into the memory means.

Inventors: TAKAYAMA TSUTOMU, TAKAYAMA, TSUTOMU, TAKAYAMA, TSUTOMU, C/O TAMAGAWA JIGYOSHO CANON K.K
Applicants: CANON KK, CANON KABUSHIKI KAISHA
Application year: 1990
Main classification: H04N9
IPC codes: H04N9