Automatic focusing apparatus taking account of panning and/or shaking

Abstract: The invention relates to automatic focusing apparatus used for a video camera or the like having a zoom mechanism. When a video camera is used for panning, the distance between the video camera and the object changes, the focusing operation is performed continuously, thus resulting in unclear de-focused images with fuzziness. To solve such problems, the application provides an automatic auto-focusing apparatus with enhanced reliability by preventing unstable focusing operation due to camera shake or panning. When a rotational movement of the lens unit (1) of a camera in a horizontal plane (due to panning, for instance) is detected by a rotational movement detecting circuit (13,14,15). A value is generated by multiplying the detected amount of change in angular velocity of the lens unit (1) by its focal length. If this value exceeds a predetermined threshold, the focusing operation is stopped by a focus controlling circuit (8) for a predetermined period of time. In order to do this the signal from the angular velocity sensor (13) is amplified by an amplifier (14) and converted into a digital signal by an A/D converter (15) for input into the focus controlling circuit (8). The focal length of the lens unit (1) is detected by a zoom lens reference position sensor (4). When the above mentioned value is above the threshold, the focus controlling circuit (8) stops focusing by acting upon the focus motor driver (6) and the focus motor (5).

Description: BACKGROUND OF THE INVENTION Field of the Invention The present invention relates automatic focusing apparatuses and, more particularly, to an automatic focusing apparatus used for a video camera or the like having a zoom mechanism. Description of the Background Art When a video camera is used for panning photography, because of the change in a distance between the video camera and an object, focusing operation is performed many times, thereby resulting in unclear defocused images with fuzziness. To solve such problem, in Japanese Patent Laying-Open No. 7-77649, for example, a method for detecting an amount of panning by an angular velocity sensor to stop focusing operation has been proposed. In this case, an output value from the angular velocity sensor is directly used for detecting the amount of panning. If the output from the angular velocity sensor does not return to a zero or reference potential in a prescribed period of time, the angular velocity sensor determines that a camera is in a process of panning and stops the focusing operation or reduces the speed of an AF (Auto Focus) motor. In an automatic focusing method of the above described conventional example, infrared radiation is emanated so that the focusing operation is performed by the light reflected by an object. There is another example of the automatic focusing method, called a climbing method, in which focusing is performed by a high frequency component of a video signal. In this method, a picture is moved due to panning or lens-shake, so that a spatial frequency and the high frequency component are reduced. As a result, it may erroneously be determined that fuzziness is caused by the change in a distance between a video camera and the object even if there is no change. This is a problem to be solved. Even with the same amount of panning or shake, if the focal lengths are different, due to the difference in zoom positions, the amounts of movements of the objects on an actual screen appear different in proportion to the focal lengths. Further, when the output from the angular velocity sensor is directly used as in the conventional example, in the case of an angular velocity sensor in which a relatively inexpensive gyro sensor is used, an output value significantly changes with a change in temperature, so that sufficient accuracy is not ensured and a significant cost is required for temperature compensation. Further, in a more preferred embodiment of the present invention, the lens unit includes a zoom mechanism. A focal length corresponding to a zoom position is detected and the detected focal length is multiplied by the amount of change in angular velocity. SUMMARY OF THE INVENTION Therefore, a main object of the present invention is to provide an automatic focusing apparatus with enhanced reliability by preventing unstable focusing operation due to camera-shake or panning. Briefly summarized, the present invention is an automatic focusing apparatus for focusing an image input to an imaging element by controlling a lens unit. In the automatic focusing apparatus, a level of a high frequency component of a video signal obtained from the imaging element is generated by a focus evaluation value generating circuit as a focus evaluation value. Further, a focusing operation is performed such that the focus evaluation value attains a maximum value by changing a relative position of a lens of the lens unit with respect to the imaging element by a focus controlling circuit. When a horizontal rotational movement of the lens unit is detected by a rotational movement detecting circuit and, a value obtained by multiplying the detected amount of change in angular velocity of the lens unit by the focal length exceeds a predetermined threshold value, the focusing operation is stopped by the focus controlling circuit for a prescribed period of time. Therefore, according to the present invention, when the value obtained by multiplying the detected amount of change in the angular velocity of the lens unit by the focal length exceeds the predetermined threshold value, the focusing operation is stopped for the predetermined period of time, whereby the automatic focusing apparatus with enhanced reliability can be implemented by preventing unstable focusing operation due to camera-shake or panning. According to a more preferred embodiment of the present invention, a focusing operation is stopped in accordance with a value obtained by multiplying a detected amount of change in angular velocity of a lens unit by a focal length and, the focusing operation is started when a focus evaluation value determined by a focus controlling circuit is kept smaller than a threshold value which is different from the focus evaluation value for a predetermined period of time. The foregoing and other objects, features, aspects and advantages of the present invention will become more apparent from the following detailed description of the present invention when taken in conjunction with the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS Fig. 1 is a block diagram showing an embodiment of the present invention. Fig. 2 is a block diagram specifically showing a focus evaluation value generating circuit in Fig. 1. Fig. 3 is a flow chart in conjunction with a specific operation of a focus controlling circuit shown in Fig. 1. Fig. 4 is a flow chart of a subroutine in conjunction with an operation of shake detecting shown in Fig. 2. DESCRIPTION OF THE PREFERRED EMBODIMENTS Referring to Fig. 1, a lens unit 1 includes a zoom lens 10 having a variable power function for varying a focal length, and a focus lens 11 controlling focusing of an object image on an imaging element. Here, zoom lens 10 and focus lens 11 move back and forth in the direction of an optical axis by driving forces of a zoom motor 2 and a focus motor 5 through mechanisms (not shown), respectively. Zoom motor 2 and focus motor 5 are driven by a zoom motor driver 3 and a focus motor driver 6, respectively. Reference positions of zoom and focus lenses 10 and 11 are detected by zoom and focus lens reference position sensors 4 and 7, respectively. The outputs obtained from the detection are both input to a focus controlling circuit 8. The object image formed on the imaging element through the above mentioned lens unit 1 passes to a video signal by photoelectric conversion through an imaging circuit 12. A high frequency component of a luminance signal portion of the video signal is used to generate a focus evaluation value by a focus evaluation value generating circuit 9, which is input to focus controlling circuit 8 for focus controlling. A horizontal angular velocity sensor 13 is mounted in the vicinity of lens unit 1 for detecting shake in the horizontal direction of lens unit 1. An output from horizontal angular velocity sensor 13 is amplified by an amplifier 14 and converted to a digital numerical value data by an A/D converter 15 for input to focus controlling circuit 8. Focus controlling circuit 8 is formed, for example of a microcomputer, and performs focus controlling based on the flow chart shown in Figs. 2 and 3, which will be later described. Fig. 2 is a block diagram specifically showing a focus evaluation value generating circuit 9 in Fig. 1. Referring to Fig. 2, a luminance signal is passed through a high pass filter (HPF) 91 and a high frequency component thereof is separated. Then, the amplitude is detected in a detecting circuit 92 in the next stage. The detected output is converted to a digital value in an A/D converter 93, and only a signal in a focus area which has been set in a central portion of the screen is extracted in a gate circuit 94 and integrated in an integrating circuit 95 for every field. Thus, a focus evaluation value of the current field is obtained. At the time, a vertical and horizontal synchronizing signal, which has been separated from the luminance signal in a synchronization separating circuit 96, is input to a gate controlling circuit 97 for setting the focus area. Gate controlling circuit 97 sets the focus area in a rectangular shape in the central portion of the screen based on the vertical and horizontal synchronizing signal and a constant output from an oscillator, and supplies a gate keying signal for gate circuit 94 which allows passage of the luminance signal only in that area. Focus evaluation value generating circuit 9 having the above described structure can always output a focus evaluation value corresponding to one field. Referring now to Figs. 1 to 4, a specific operation of the embodiment of the present invention will be described. In a step (abbreviated as an SP in the drawings) SP1 shown in Fig. 3, focus controlling circuit 8 receives a focus evaluation value from a focus evaluation value generating circuit 9 and compares the focus evaluation value with a predetermined threshold value β in a step SP2. Here, assume that threshold value β is smaller than the focus evaluation value obtained when focusing is achieved. Then, if the focus evaluation value is smaller than threshold value β, focus controlling circuit 8 determines that fuzziness exists. While threshold value β may be a fixed value, it may also be changed depending on iris opening or luminance variation of a screen. When focus controlling circuit 8 determines that the focus evaluation value exceeds threshold value β, it resets an evaluation value decreasing counter formed of a software to 0 in a step SP3. On the other hand, when focus controlling circuit 8 determines that threshold value β exceeds the focus evaluation value, it increments the evaluation value decreasing counter in a step SP4. Then, in a step SP5, if the evaluation value decreasing counter is at or greater than a prescribed value T B , focus controlling circuit 8 determines that fuzziness really exists as the focus evaluation value is continuously kept at a low value. As a result, focus controlling circuit 8 inputs T B to the evaluation value decreasing counter in a step SP17, resets an AF stop counter formed of the software to 0 in a step SP15 and performs a usual AF processing in a step SP16. The value of T B is set between several msec and several hundreds of msec. If the focus evaluation value is not continuously kept at a low value, shake detecting is performed in a step SP7 if zooming is not being performed in a step SP6. The shake detecting subroutine will later be described. Because defocusing may often be caused during zooming especially from the wide direction to the tele direction, the AF stop is not performed during zooming in step SP6. Thereafter, when a strong shake flag set by the shake detecting subroutine in step SP7 indicates 1, the value of the AF stop counter is set at Tα 1 in a step SP9. If the strong shake flag indicates 0 and only a shake flag indicates 1 in a step SP8, the value of the AF stop counter is set at Tα 2 in a step SP11. Here, assume that Tα 1 ≧ Tα 2 and the values of Tα 1 and Tα 2 are between several msec and several hundreds of msec. If the AF stop counter is not at 0 in a step SP12, it is decremented in a step SP13 and the AF stop processing is performed in a step SP14. If the AF stop counter is at 0 in step SP12, the usual AF processing is performed in a step SP16. Referring now to Fig. 4, the shake detecting subroutine will be described. An output from angular velocity sensor 13 is amplified by amplifier 14, angular velocity data A/D converted by A/D converter 15 is received in a step SP21 and a focal length is obtained from a zoom position. In a step SP22, angular velocity data, which has been used last time, is subtracted from the received angular velocity data and, the result is multiplied by the focal length to obtain an amount of change in angular velocity. It is determined in a step SP23 if an absolute value of the amount of change in angular velocity is greater than threshold value α 1 , and if the absolute value is greater than threshold value α 1 , the strong shake flag is set in a step SP25. If it is determined in a step SP24 that the absolute value is greater than α 2 , the shake flag is set in a step SP26. If the absolute value is smaller than α 2 , both strong shake flag and shake flag are cleared in a step SP27. Assume that α 1 > α 2 , where α 1 and α 2 are set in consideration with the balance with the variation in the focus evaluation value. Further, assume that α 2 represents an absolute value of the amount of change in angular velocity, which value causes the variation in the evaluation value which may or may not influence the AF operation. Finally, in a step SP28, the angular velocity data received this time is stored as angular velocity data of last time for using it next time. Here, supplementary description of the above described AF stop processing will be provided. While a method of stopping the driving of focus lens 11 by focus motor 5 shown in Fig. 1 is possible as a method of AF stopping, alternatively, the AF stopping may be performed by preventing refocusing or by preventing only a part of the AF processing. For example, when a series of AF operations includes controlling of the direction, climbing, acknowledging an apex and monitoring, the driving of focus lens 11 may be stopped only during the acknowledging of the apex and monitoring. As described above, according to the present embodiment, unstable focusing operation due to camera-shake, panning or the like is prevented. In other words, variations in the spatial frequency of the picture and in the focus evaluation value which is the high frequency component of the video signal only occur when the angular velocity changes. In addition, as an amount of movement of the object on the actual screen is proportional to the focal length, a value obtained by multiplying the amount of change in angular velocity by the focal length is defined as a shake variation value. When the shake variation value exceeds a prescribed threshold value α, the auto focus operation is stopped for a given period T or a period Tα which changes with threshold value α. As the high frequency component of at least 100kHz to several hundreds of kHz is generally used for the focus evaluation value and such high frequency component is related to a vertical line on the screen, shaking in a transverse direction which causes blurring of a vertical component of the image needs only be detected. Thus, angular velocity sensor 13 needs only function in the horizontal direction. In addition, although stopping of the auto focus operation when camera-shake and panning are caused in a focused state is effective for stabilizing auto focusing, stopping the auto focus operation initially in a defocused state would result in an unclear image. Therefore, auto focusing had better not be stopped in the defocused state. In a focused state, even if the focus evaluation value may significantly be decreased temporarily due to camera-shake and panning, it is rarely decreased continuously. This is because panning exactly at the same speed is impossible. Therefore, when the focus evaluation value becomes lower than threshold value β for a given period Tβ, it is determined that the lens unit is in the defocused state and stopping of the auto focusing due to camera-shake and panning is not performed and, when the auto focusing is stopped, it is started. As in the foregoing, according to the embodiment of the present invention, by stopping the focusing operation for a predetermined period of time when the value obtained by multiplying the amount of change in angular velocity of the lens unit detected by the angular velocity sensor by the focal length exceeds the predetermined threshold value, the unstable auto focus operation due to camera-shake and panning is prevented and the automatic focusing apparatus with enhanced reliability can be implemented. Although the present invention has been described and illustrated in detail, it is clearly understood that the same is by way of illustration and example only and is not to be taken by way of limitation, the scope of the present invention being limited only by the terms of the appended claims.

Claims: An automatic focusing apparatus for focusing an image input to an imaging element (12) by controlling a lens unit (1), comprising: focus evaluation value generating means (9) for outputting a level of a high frequency component of a video signal obtained from said imaging element as a focus evaluation value; focus controlling means (5, 6, 8) for changing a relative position of a lens of said lens unit with respect to said imaging element to perform a focusing operation such that said focus evaluation value attains a maximum value; rotational movement detecting means (13) for detecting a rotational movement of said lens unit in a horizontal plane; and controlling means (8) for stopping said focusing operation by said focus controlling means for a predetermined period of time when a value obtained by multiplying an amount of change in angular velocity of said lens unit detected by said rotational movement detecting means by the focal length of said lens unit exceeds a predetermined threshold value. The automatic focusing apparatus according to claim 1, wherein said controlling means changes a period of time during which said focusing operation is stopped in accordance with said detected value obtained by multiplying said amount of change in angular velocity of said lens unit by said focal length. The automatic focusing apparatus according to claim 1, further comprising means for starting said focusing operation when said focus evaluation value from said focus controlling means is continuously kept lower than a threshold value different from said predetermined threshold value for said predetermined period of time. The automatic focusing apparatus according to claim 1 or 2 or 3, further comprising focal length detecting means for detecting a focal length corresponding to a zoom position of said lens unit, wherein said lens unit includes a zoom mechanism and said controlling means multiplies the focal length detected by said focal length detecting means (4) by said amount of change in angular velocity.

Inventors: TSUJINO KAZUHIRO, TSUJINO, KAZUHIRO
Applicants: SANYO ELECTRIC CO, SANYO ELECTRIC CO., LTD.
Application year: 1998
Main classification: G02B7
IPC codes: G02B7, G02B27, H04N5