Patent Description:
An optical image stabilization method that optically corrects image blur caused by shake (camera shake) of the image pickup apparatus is classified into a lens shift method (optical-system IS or simply referred to as OIS hereinafter) that moves a correction lens relative to an optical axis, and a sensor shift method (image-sensor IS or simply referred to as IIS hereinafter) that moves an image sensor relative to the optical axis. Japanese Patent No. (<CIT> discloses a camera system that performs optical image stabilization using both OIS and IIS. <CIT> discloses a method of providing good image stabilizing performance for a larger camera shake of the entire camera system by properly setting a correction ratio between OIS and IIS.

An imaging optical system that forms an object image on the image sensor generally has distortion. Therefore, when the position (orientation) of the image pickup apparatus changes due to the camera shake, image point moving amounts are mutually different between a central portion (near the optical axis) and a peripheral portion due to the influence of the distortion.

In addition, eccentric distortion occurs in a case where the correction lens is shifted (decentered) by OIS. Therefore, OIS also causes a difference in the image point moving amount between the central portion and the peripheral portion. On the other hand, even if the image sensor is moved by IIS, the image point moving amount in the central portion is the same as that in the peripheral portion. Therefore, if IIS is performed in accordance with the image point moving amount in the central portion caused by the camera shake, an image blur remains in the peripheral portion. Furthermore, when the image point moving amount due to the distortion caused by the camera shake is different from that due to the eccentric distortion in OIS, even if the correction is performed in accordance with the image point moving amount in the central area, an appropriate correction cannot be performed in the peripheral area. Therefore, even in a case where both OIS and IIS are used, it is difficult to satisfactorily correct image blur both at the central portion and at the peripheral portion. Document <CIT> discloses a camera system that includes a lens unit and a camera body, wherein the camera body includes a blur correcting unit that performs blur correction in a plurality of directions, and a determining unit that determines whether the lens unit mounted onto the camera body is a lens unit that performs the blur correction in the plurality of directions. When the determining unit determines that the mounted lens unit is the lens unit that performs the blur correction in the plurality of directions, the camera body performs the blur correction in the plurality of directions at a camera body side blur correction ratio, and the lens unit performs the blur correction in the plurality of directions at a lens unit side blur correction ratio.

One of the aspects of the present disclosure provides a control apparatus as specified in claim <NUM> and an optical apparatus having the control apparatus, each of which can perform proper image stabilization according to a shake amount using both OIS and IIS.

The present disclosure in its first aspect provides a control apparatus as specified in claims <NUM> to <NUM>.

The present disclosure in its second aspect provides an optical apparatus as specified in claim <NUM>.

The present disclosure in its third aspect provides a control method as specified in claim <NUM>.

The present disclosure in its fourth aspect provides a program as specified in claim <NUM>.

Further features of the disclosure will become apparent from the following description of embodiments with reference to the attached drawings. In the following, the term "unit" may refer to a software context, a hardware context, or a combination of software and hardware contexts. In the software context, the term "unit" refers to a functionality, an application, a software module, a function, a routine, a set of instructions, or a program that can be executed by a programmable processor such as a microprocessor, a central processing unit (CPU), or a specially designed programmable device or controller. A memory contains instructions or program that, when executed by the CPU, cause the CPU to perform operations corresponding to units or functions. In the hardware context, the term "unit" refers to a hardware element, a circuit, an assembly, a physical structure, a system, a module, or a subsystem. It may include mechanical, optical, or electrical components, or any combination of them. It may include active (e.g., transistors) or passive (e.g., capacitor) components. It may include semiconductor devices having a substrate and other layers of materials having various concentrations of conductivity. It may include a CPU or a programmable processor that can execute a program stored in a memory to perform specified functions. It may include logic elements (e.g., AND, OR) implemented by transistor circuits or any other switching circuits. In the combination of software and hardware contexts, the term "unit" or "circuit" refers to any combination of the software and hardware contexts as described above. In addition, the term "element," "assembly," "component," or "device" may also refer to "circuit" with or without integration with packaging materials.

Referring now to the accompanying drawings, a description will be given of embodiments according to the disclosure.

Prior to a description of the embodiments, a comparative example (base technology examples) for the embodiments will be described.

<FIG> illustrates a configuration of an imaging system according to the comparative example. The imaging system includes an interchangeable lens <NUM> as a first optical apparatus and a camera body <NUM> as a second optical apparatus to which the interchangeable lens <NUM> is detachably and communicatively connected. The camera body <NUM> includes a camera MPU <NUM>, an operation unit <NUM>, an image sensor <NUM>, a camera-side contact terminal <NUM>, a camera-side gyro sensor <NUM>, an acceleration sensor <NUM>, and a rear display <NUM>.

The camera MPU <NUM> is a controller that governs the overall control of the camera body <NUM> and the interchangeable lens <NUM>, and controls a variety of operations such as auto-exposure (AE), autofocus (AF), and imaging according to inputs from the operation unit <NUM>, which will be described below. The camera MPU <NUM> communicates various commands and information with the lens MPU <NUM> through the camera-side contact terminal <NUM> and a lens-side contact terminal <NUM> provided on the interchangeable lens <NUM>. The camera-side contact terminal <NUM> and the lens-side contact terminal <NUM> also include power terminals for supplying power from the camera body <NUM> to the interchangeable lens <NUM>.

The operation unit <NUM> includes a mode dial for setting a variety of imaging modes, a release button for instructing an imaging preparation operation and an imaging start, and the like. When the release button is half-pressed, a first switch (SW1) is turned on, and when the release button is fully pressed, a second switch (SW2) is turned on. When SW1 is turned on, AE and AF are performed as the imaging preparation operation, and when SW2 is turned on, the AE setting is finalized, AF is stopped, and the like, and an instruction to start imaging (exposure) is issued (SW2-<NUM> is turned on). A predetermined time after the instruction is issued, actual exposure is started (SW2-<NUM> is turned on). SW2-<NUM> and SW2-<NUM> are turned off when the set exposure time has passed and the imaging has ended. The turning on and off states of SW1, SW2-<NUM>, and SW2-<NUM> are notified from the camera MPU <NUM> to the lens MPU <NUM> through communication.

The image sensor <NUM> includes a photoelectric conversion element such as a CCD sensor or a CMOS sensor, and photoelectrically converts an object image formed by an imaging optical system, which will be described below, to generate an imaging signal. The camera MPU <NUM> generates a video signal using the imaging signal from the image sensor <NUM>.

The camera-side gyro sensor <NUM> is a shake sensor that detects angular shake (camera shake) applied to the camera body <NUM> due to camera shake or the like and outputs an angular velocity signal as a camera shake detection signal. The camera MPU <NUM> drives an image sensor actuator <NUM> based on the angular velocity signal and an IIS correction ratio, which will be described below, to move the image sensor <NUM> in a direction orthogonal to the optical axis of the imaging optical system, which will be described below. Thereby, image blur caused by camera shake is reduced (or corrected). At this time, the camera MPU <NUM> performs feedback control over the image sensor actuator <NUM> so that the position of the image sensor <NUM> detected by an image sensor position sensor <NUM> (or a moving amount from a position on the optical axis as a moving center) approaches the target position. Thereby, image stabilization that moves the image sensor <NUM>, that is, IIS is performed.

The acceleration sensor <NUM> is used to detect the orientation of the camera body <NUM>, and to detect shift shake, which is difficult to detect with the camera-side gyro sensor <NUM>, among camera shakes. The rear display <NUM> as a display unit displays an image corresponding to the video signal generated by the camera MPU <NUM> using the imaging signal from the image sensor <NUM>. Before imaging is made, the user can observe a displayed image as a finder image (live-view image). After imaging is made, a still or moving image for recording generated by imaging can be displayed on the rear display <NUM>. The term "imaging" used in this description means imaging for recording.

The interchangeable lens <NUM> includes the unillustrated imaging optical system, the lens MPU <NUM>, the lens-side contact terminal <NUM>, and a lens-side gyro sensor <NUM>. The lens-side gyro sensor <NUM> is a shake sensor that detects angular shake (lens shake) of the interchangeable lens <NUM> and outputs a lens shake detection signal as an angular velocity signal.

The lens MPU <NUM> drives a lens actuator <NUM> based on a lens shake detection signal and an OIS correction ratio, which will be described below, to move a correction lens <NUM> as a correction optical system constituting at least part of the imaging optical system, in a direction orthogonal to the optical axis of the imaging optical system. At this time, the lens MPU <NUM> performs feedback control over the lens actuator <NUM> so that the position of the correction lens <NUM> detected by a lens position sensor <NUM> (or a moving amount from a position on the optical axis as a moving center) approaches the target position. Accordingly, image stabilization that moves the correction lens <NUM>, that is, OIS is performed.

The lens actuator <NUM> and correction lens <NUM> correspond to the first image stabilizing unit, and the image sensor actuator <NUM> and image sensor <NUM> correspond to the second image stabilizing unit.

<FIG> illustrates a configuration of an image stabilizing system in an imaging system according to the comparative example. The image stabilizing system includes a lens IS control unit <NUM> that controls the entire IS system including OIS and IIS as an IS control apparatus (control apparatus), and a camera IS control unit <NUM> that controls IIS together with the OIS control unit <NUM>. The lens IS control unit <NUM> is provided in the lens MPU <NUM>, and the camera IS control unit <NUM> is provided in the camera MPU <NUM>. Instead of the lens IS control unit <NUM>, the camera IS control unit <NUM> may serve as the IS control apparatus (control apparatus) to control the entire IS system.

In the camera IS control unit <NUM>, a camera gyro offset remover <NUM> removes an offset component from the angular velocity signal detected by the camera-side gyro sensor <NUM> mounted on the camera body <NUM>. A camera-side angle converter <NUM> converts an angular velocity signal output from the camera gyro offset remover <NUM> into an angle signal.

A camera information memory <NUM> stores IIS driving information and IIS sensitivity information. The IIS driving information is information about driving such as the maximum driving amount of the image sensor <NUM>. The IIS sensitivity information is an image point moving amount for each image height from the central portion to the peripheral portion on the imaging plane (referred to as an image point moving amount hereinafter) relative to a predetermined moving amount (unit moving amount) of the image sensor <NUM>, that is, information about image stabilizing sensitivity (IIS sensitivity). <FIG> illustrates the IIS sensitivity at each image height, an image blur amount that is the image point moving amount at each image height when the camera shake occurs such that the image point moving amount at the central portion is <NUM>, and an IIS peripheral correction residue amount that is an image blur residue amount to be corrected at each image height on the peripheral side further than the central portion when the image sensor <NUM> is driven to correct the image blur in the central portion. In <FIG>, the image blur amount increases as the image height increases from the central portion. The IIS sensitivity is constant regardless of the image height. As a result, the IIS peripheral correction residue amount obtained by subtracting the IIS sensitivity from the image blur amount increases as the image height increases from the central portion.

The IIS sensitivity information may be information indicating the IIS sensitivity itself as illustrated in <FIG>, or may be information that can be converted into the IIS sensitivity or a function for calculating the IIS sensitivity. The IIS sensitivity information may be information indicating the IIS peripheral correction residue amount illustrated in <FIG>. Furthermore, the IIS sensitivity information may be information indicating the IIS correction ratio described later. Since the IIS peripheral correction residue amount and the IIS correction ratio are determined by the IIS sensitivity, both of them are information related to the IIS sensitivity.

The IIS sensitivity information may be information indicating an image stabilization residue amount (referred to as an IIS peripheral correction residue amount hereinafter) to be corrected for each image height on the peripheral side of the central portion in a case where the image sensor <NUM> is driven to correct a predetermined image blur amount in the central portion, as illustrated in <FIG>. Since the IIS peripheral correction residue amount is determined by the IIS sensitivity, it is information about the IIS sensitivity. The IIS driving information and IIS sensitivity information are transmitted to the lens IS control unit <NUM> via a camera transmitter <NUM>.

The camera-side cooperative control unit <NUM> receives and stores IIS correction ratio information, which will be described below, from the lens IS control unit <NUM> via a camera receiver <NUM>. An image sensor driving control unit <NUM> generates an IIS driving signal for driving the image sensor <NUM> according to the angle signal from the camera-side angle converter <NUM> and the IIS correction ratio output from the camera-side cooperative control unit <NUM>. The image sensor actuator <NUM> that receives the IIS driving signal drives the image sensor <NUM> in a direction orthogonal to the optical axis.

In the lens IS control unit <NUM>, a lens gyro offset remover <NUM> removes an offset component from the angular velocity signal detected by the lens-side gyro sensor <NUM> mounted on the interchangeable lens <NUM>. A lens-side angle converter <NUM> converts the angular velocity signal output from the lens gyro offset remover <NUM> into an angle signal.

A lens information memory <NUM> stores OIS driving information and OIS sensitivity information. The OIS driving information is information about driving such as the maximum driving amount of the correction lens <NUM>. The OIS sensitivity information is information about the image point moving amount for each image height from the central portion to the peripheral portion on the imaging plane relative to a predetermined moving amount (unit moving amount) of the correction lens <NUM>, that is, image stabilization sensitivity (OIS sensitivity). <FIG> illustrates the OIS sensitivity at each image height, the image blur amount described above, and an OIS peripheral correction residue amount that is an image blur residue amount to be corrected at each image height on the peripheral side further than the central portion when the image sensor <NUM> is driven to correct the image blur in the central portion. In <FIG>, the OIS sensitivity increases as the image height increases from the central portion. As a result, the OIS peripheral correction residue amount obtained by subtracting the OIS sensitivity from the image blur amount increases as the image height increases from the central portion, but the OIS peripheral correction residue amount becomes smaller than the IIS peripheral correction residue amount.

The OIS sensitivity information may be information indicating the OIS sensitivity itself as illustrated in <FIG>, or may be information that can be converted into the OIS sensitivity or a function for calculating the OIS sensitivity. The OIS sensitivity information may be information indicating the OIS peripheral correction residue amount illustrated in <FIG>. Furthermore, the OIS sensitivity information may be information indicating the OIS correction ratio described later. Since the OIS peripheral correction residue amount and the OIS correction ratio are determined by the OIS sensitivity, both of them are information related to the OIS sensitivity.

The OIS sensitivity information may be information indicating an image stabilization residue amount (referred to as an OIS peripheral correction residue amount hereinafter) to be corrected for each image height on the peripheral side of the central portion in a case where the correction lens <NUM> is driven to correct a predetermined image blur amount in the central portion. Since the OIS peripheral correction residue amount is determined by the OIS sensitivity, it is information about the OIS sensitivity.

The OIS sensitivity information and the IIS sensitivity information may be different information depending on a zoom state of the imaging optical system and a position of a focus lens.

A lens-side cooperative control unit (an acquiring unit and a setting unit) <NUM> reads the OIS driving information and OIS sensitivity information from the lens information memory <NUM>. The lens-side cooperative control unit <NUM> receives the IIS driving information and IIS sensitivity information from the camera IS control unit <NUM> via the lens receiver <NUM>. The lens-side cooperative control unit <NUM> calculates and determines the OIS correction ratio and the IIS correction ratio, which are ratios of the image blur amounts to be respectively corrected by OIS and IIS, on the basis of the OIS drive information and the IIS drive information, and the OIS peripheral correction residue amount (first information) and the IIS peripheral correction residue amount (second information) respectively calculated from the image blur amount and the OIS sensitivity information and IIS sensitivity information. The lens-side cooperative control unit <NUM> outputs the determined OIS correction ratio to a correction lens driving control unit <NUM>. The lens-side cooperative control unit <NUM> transmits information on the determined IIS correction ratio to the camera IS control unit <NUM> (camera-side cooperative control unit <NUM>) via a lens transmitter <NUM>.

The correction lens driving control unit <NUM> generates an OIS driving signal for driving the correction lens <NUM> according to the angle signal from the lens-side angle converter <NUM> and the OIS correction ratio from the lens-side cooperative control unit <NUM>. Upon receiving the OIS driving signal, the lens actuator <NUM> drives the correction lens <NUM> in the direction orthogonal to the optical axis.

The above operation of the image stabilizing system may be normally performed after the imaging system is powered on, or may be performed only during imaging. During a non-imaging period after the power is turned on, either IIS or OIS may be driven, or the operation of the image stabilizing system may be stopped.

A flowchart in <FIG> illustrates image stabilizing control processing (image stabilizing control method) performed by the lens IS control unit <NUM> (lens-side cooperative control unit <NUM>) and the camera IS control unit <NUM> (camera-side cooperative control unit <NUM>). The lens IS control unit <NUM> and the camera IS control unit <NUM> as computers execute this processing according to the program. S in the figure stands for the step.

After the imaging system is powered on and the camera MPU <NUM> and lens MPU <NUM> perform initial operations, the lens IS control unit <NUM> and camera IS control unit <NUM> start this processing.

First, in step S301, the lens IS control unit <NUM> reads the OIS driving information and the OIS sensitivity information from the lens information memory <NUM> and receives the IIS driving information and the IIS sensitivity information from the camera IS control unit <NUM>.

Next, in step S302, the lens IS control unit <NUM> calculates OIS correction ratios A, B, and C and IIS correction ratios (<NUM>-A), (<NUM>-B), and (<NUM>-C). The OIS correction ratio and the IIS correction ratio are ratios of the image stabilizing amount by OIS and the image stabilizing amount by IIS in the image stabilizing amount by the entire image stabilizing system consisting of OIS and IIS. The OIS correction ratio may be selected between <NUM> and <NUM>, or may be a value equal to or larger than <NUM>. In a case where the OIS correction ratio is larger than <NUM>, OIS overcorrects image blur, and IIS returns the overcorrection in accordance with a negative IIS correction ratio. A specific example of the OIS correction ratio will be described below.

Each of the OIS correction ratio A and the IIS correction ratio (<NUM>-A) correspond to a first ratio, and each of the OIS correction ratio C and the IIS correction ratio (<NUM>-C) correspond to a second ratio. Each of the OIS correction ratio B and the IIS correction ratio (<NUM>-B) correspond to a third ratio.

Next, in step S303, the lens IS control unit <NUM> calculates an image stabilizing amount "a" by the entire IS system. More specifically, the lens IS control unit <NUM> calculates the image stabilizing amount "a" from the angle signal from the lens-side angle converter <NUM>. At this time, the camera IS control unit <NUM> also calculates the image stabilizing amount "a" from the angle signal from the camera-side angle converter <NUM>.

Next, in step S304, the lens IS control unit <NUM> compares the absolute value of the image stabilizing amount "a" with a threshold (first predetermined value) TH1. In a case where the absolute value of the image stabilizing amount "a" is smaller than the threshold TH1, the lens IS control unit <NUM> calculates a driving amount of the correction lens <NUM> (referred to as an OIS driving amount hereinafter) from the image stabilizing amount "a" and the OIS correction ratio A in step S306, and generates an OIS driving signal corresponding to the OIS driving amount. Thereby, OIS with the OIS correction ratio A is performed. At this time, the lens IS control unit <NUM> also transmits the IIS correction ratio (<NUM>-A) to the camera IS control unit <NUM>. In step S307, the camera IS control unit <NUM> calculates a driving amount of the image sensor <NUM> (referred to as an IIS driving amount hereinafter) from the image stabilizing amount "a" and the received IIS correction ratio (<NUM>-A) and generates an IIS driving signal corresponding to the IIS driving amount. Thereby, IIS is performed with the IIS correction ratio (<NUM>-A).

In a case where the absolute value of the image stabilizing amount "a" is equal to or larger than the threshold TH1 in step S304, the lens IS control unit <NUM> compares the absolute value of the image stabilizing amount "a" with a threshold (second predetermined value) TH2 in step S305. The threshold TH2 is a value larger than the threshold TH1. In a case where the absolute value of the image stabilizing amount "a" is equal to or larger than the threshold TH2, the lens IS control unit <NUM> calculates an OIS driving amount from the image stabilizing amount "a" and the OIS correction ratio C in step S310 and generates an OIS driving signal corresponding to the OIS driving amount. Thereby, OIS with the OIS correction ratio C is performed. At this time, the lens IS control unit <NUM> transmits the IIS correction ratio (<NUM>-C) to the camera IS control unit <NUM>. In step S311, the camera IS control unit <NUM> calculates an IIS driving amount from the image stabilizing amount "a" and the received IIS correction ratio (<NUM>-C), and generates an IIS driving signal corresponding to the IIS driving amount. Thereby, IIS with the IIS correction ratio (<NUM>-C) is performed.

In a case where the absolute value of the image stabilizing amount "a" is smaller than the threshold TH2 in step S305, the lens IS control unit <NUM> calculates an OIS driving amount from the image stabilizing amount "a" and the OIS correction ratio B in step S308 and generates an OIS driving signal corresponding to the OIS driving amount. Thereby, OIS with the OIS correction ratio B is performed. At this time, the lens IS control unit <NUM> transmits the IIS correction ratio (<NUM>-B) to the camera IS control unit <NUM>. The camera IS control unit <NUM> calculates an IIS driving amount from the image stabilizing amount "a" and the received IIS correction ratio (<NUM>-B), and generates an IIS driving signal corresponding to the IIS driving amount. Thereby, IIS with the IIS correction ratio (<NUM>-B) is performed.

In step S312, the lens IS control unit <NUM> determines whether or not to stop the operation of the image stabilizing system. More specifically, the operation of the image stabilizing system is stopped in a case where imaging is completed, in a case where the user instructs to stop the operation of the image stabilizing system, in a case where the imaging system (camera body <NUM>) is powered off, or the like. In a case where the operation of the image stabilizing system is to be continued, the processing from step S303 and the subsequent steps are repeated, and in a case where the operation is to be stopped, this processing ends.

A description will now be given of a method of calculating the OIS correction ratios A, B, and C and the IIS correction ratios (<NUM>-A), (<NUM>-B), and (<NUM>-C). A description will now be given of a case where each correction ratio is calculated according to a comparison result between the OIS peripheral correction residue amount Ld and the IIS peripheral correction residue amount Cd described above. However, each correction ratio may be calculated according to the comparison result of the OIS sensitivity and the IIS sensitivity in the peripheral portion.

In a case where the absolute value of the OIS peripheral correction residue amount Ld is smaller than the absolute value of the IIS peripheral correction residue amount Cd, A=<NUM> and C=<NUM> are set. B is set so as to vary between A and C according to the image stabilizing amount "a," for example, as illustrated in equation (<NUM>) below.

In a case where the absolute value of the IIS peripheral correction residue amount Cd is smaller than the absolute value of the OIS peripheral correction residue amount Ld, A=<NUM> and C=<NUM> are set. B is set so as to vary between A and C according to the image stabilizing amount "a," for example, as illustrated in the following equation (<NUM>).

<FIG> illustrates the OIS correction ratios A, B, and C and the IIS correction ratio (<NUM>-A), (<NUM>-B), and (<NUM>-C) relative to the image stabilizing amount "a" in a case where the absolute value of the OIS peripheral correction residue amount Ld is smaller than the absolute value of the IIS peripheral correction residue amount Cd. A horizontal axis indicates the image stabilizing amount (total correction amount) "a" in the entire image stabilizing system, and A vertical axis indicates the correction ratio. <FIG> illustrates an example of temporal changes in the image stabilizing amount by OIS (OIS amount) and the image stabilizing amount by IIS (IIS amount) against the total correction amount "a" in a case where the IIS correction ratios A, B, and C and the IIS correction ratios (<NUM>-A), (<NUM>-B), and (<NUM>-C) illustrated in <FIG> are used. A horizontal axis indicates time, and a vertical axis indicates the image stabilizing amount.

As described above, in a case where the image stabilizing amount (that is, the shake amount of the imaging system) is smaller than the threshold TH1, the comparative example gives preferentially uses one of OIS and IIS which has a smaller peripheral correction residue amount, that is, increases the correction ratio. Thereby, this comparative example can satisfactorily correct image blur in the central portion and reduces the IS residue amount in the peripheral portion. On the other hand, in a case where the image stabilizing amount is equal to or larger than the threshold TH2, the comparative example preferentially uses one of OIS and IIS which has a larger peripheral correction residue amount. Thereby, in a case where a large shake is applied to the imaging system, this comparative example can satisfactorily correct image blur in the central portion. In a case where the image stabilizing amount is equal to or larger than the threshold TH1 and smaller than TH2, this comparative example gradually changes the correction ratio according to the image stabilizing amount, thereby suppressing abrupt operations of OIS and IIS and stabilizing the controllability.

By changing the OIS and IIS correction ratios according to the detected shake amount, this comparative example can perform proper image stabilization for both small and large shake amounts.

A description will now be given of the embodiment of this disclosure. The configurations of the camera body <NUM>, the interchangeable lens <NUM>, the camera IS control unit <NUM> and the lens IS control unit <NUM> and the basic part of the image stabilization processing in this embodiment are the same as those in the comparative example.

This embodiment is different from the comparative example in the method of calculating the OIS correction ratios A, B, and C. More specifically, the correction ratio is calculated according to a magnitude correlation between the absolute value of the image stabilizing amount "a" and the threshold TH1, instead of the magnitude correlation of the absolute value of the peripheral correction residue amount as in the comparative example.

The OIS correction ratio A and the IIS correction ratio (<NUM>-A) are calculated by the following equations (<NUM>).

Thus, the OIS correction ratio A is calculated from a ratio between the OIS or IIS peripheral correction residue amount (that is, a value relating to the image blur residue at the peripheral image height) and a difference between the OIS and IIS peripheral correction residue amounts. Thereby, OIS and IIS can be used to correct image blur in the central portion, and the OIS can be used to correct image blur in the peripheral portion.

The OIS correction ratio C is set to <NUM> in a case where an IS residue amount correctable by OIS with the OIS correction ratio A becomes <NUM> faster than an IS residue amount correctable by IIS with the IIS correction ratio (<NUM>-A), otherwise C is set to <NUM>. That is, the following equations are established: <MAT> <MAT> where Lαmax is the maximum image stabilizable amount by OIS (referred to as a maximum OIS amount hereinafter), and Cαmax is the maximum image stabilizable amount by IIS (referred to as a maximum IIS amount hereinafter).

Information about the maximum OIS amount Lαmax (third information) and information about the maximum IIS amount Cαmax (fourth information) are stored in the lens information memory <NUM> and the camera information memory <NUM>, respectively. These pieces of information may be information indicating the maximum IS amount itself, information that can be converted into the maximum IS amount, or information indicating the maximum drivable amounts of OIS and IIS.

The lens IS control unit <NUM> compares the maximum OIS amount Lαmax obtained from the information read out of the lens information memory <NUM> and the maximum IIS amount Cαmax obtained from the information received from the camera IS control unit <NUM>. Then, the OIS correction ratio C and the IIS correction ratio (<NUM>-C) are determined based on the comparison result.

The OIS correction ratio B is set with equation (<NUM>), for example, so that it changes between A and C according to the image stabilizing amount "a.

<FIG> illustrate the OIS correction ratios A, B, and C and the IIS correction ratios (<NUM>-A), (<NUM>-B), and (<NUM>-C) against the image stabilizing amount "a" in this embodiment. A horizontal axis represents the image stabilizing amount (total correction amount) "a" in the entire image stabilizing system, and a vertical axis represents a correction ratio.

<FIG> illustrates the OIS correction ratio and the OIS correction ratio in a case where the OIS peripheral correction residue amount Ld and the IIS peripheral correction residue amount Cd have signs opposite to each other, that is, in a case where the image point moving direction in the central portion is different between OIS and IIS. "A" is set by equation (<NUM>) and C is set to <NUM>. <FIG> illustrates an example of temporal changes in the OIS amount and the IIS amount against the total correction amount "a" in a case where the IIS correction ratio and the IIS correction ratio illustrated in <FIG> are used.

<FIG> illustrates the OIS correction ratio and the IIS correction ratio in a case where the OIS peripheral correction residue amount Ld and the IIS peripheral correction residue amount Cd have the same signs, that is, in a case where OIS and IIS have the same image point moving direction in the central portion. "A" is set by equation (<NUM>) and C is set to <NUM>. <FIG> illustrates an example of temporal changes in the OIS amount and the IIS amount against the total correction amount "a" in a case where the IIS correction ratios A, B, and C and the IIS correction ratios (<NUM>-A), (<NUM>-B), and (<NUM>-C) illustrated in <FIG> are used.

<FIG> illustrates other examples of the OIS correction ratios A, B, and C and the IIS correction ratios (<NUM>-A), (<NUM>-B), and (<NUM>-C) against the image stabilizing amount "a. " In this example, the OIS correction ratio A is set according to equation (<NUM>) and C is set to <NUM>.

In a case where the image stabilizing amount is smaller than the threshold TH1, this embodiment preferentially uses one of OIS and IIS which has a smaller peripheral correction residue amount and can satisfactorily correct image blur in the central portion and reduce the IS residue amount in the peripheral portion. On the other hand, in a case where the image stabilizing amount is equal to or larger than the threshold TH2, this embodiment preferentially uses one of OIS and IIS which has a larger maximum image stabilizable amount and can more satisfactorily correct image blur in the central portion than the comparative example even when a large shake is applied to the imaging system. In a case where the image stabilizing amount is equal to or larger than the threshold H1 and smaller than TH2, this embodiment gradually changes the correction ratio according to the image stabilizing amount, thereby suppressing abrupt operations of OIS and IIS and stabilizing the controllability.

By switching the OIS and IIS correction ratios according to the detected shake amount, this embodiment can perform proper image stabilization for both small and large shake amounts.

The above embodiment can perform proper image stabilization according to the shake amount using both the first image stabilizing unit (OIS) and the second image stabilizing unit (IIS).

Claim 1:
A control apparatus (<NUM>) configured to control, based on a detected shake amount, driving of a first image stabilizing unit (<NUM>, <NUM>) for image stabilization by moving a correction optical system (<NUM>) that constitutes at least part of an imaging optical system and a second image stabilizing unit (<NUM>, <NUM>) for image stabilization by moving an image sensor (<NUM>) configured to capture an object image formed by the imaging optical system, the control apparatus (<NUM>) comprising:
an acquiring unit (<NUM>) configured to acquire first information about an image blur residue to be corrected relative to a moving amount of the correction optical system (<NUM>), when the first image stabilizing unit (<NUM>, <NUM>) is driven, second information about an image blur residue to be corrected relative to a moving amount of the image sensor (<NUM>), when the second image stabilizing unit (<NUM>, <NUM>) is driven, third information about a maximum image stabilizable amount of the first image stabilizing unit (<NUM>, <NUM>), and fourth information about a maximum image stabilizable amount of the second image stabilizing unit (<NUM>, <NUM>); and
a setting unit (<NUM>) configured to set a correction ratio between the first image stabilizing unit (<NUM>, <NUM>) and the second image stabilizing unit (<NUM>, <NUM>),
characterized in that the setting unit (<NUM>) is configured to set to the correction ratio a first ratio (A, <NUM>-A) based on the first information and the second information, and a second ratio (C, <NUM>-C) based on the third information and the fourth information,
wherein the setting unit (<NUM>) is configured to switch the correction ratio between the first ratio (A, <NUM>-A) and the second ratio (C, <NUM>-C) according to the shake amount.