System for reducing defocusing of an object image due to temperature changes

An image pickup apparatus operable to reduce defocusing due to temperature changes is disclosed. An optical system comprises a glass lens and a plastic lens, wherein a power of the plastic lenses is smaller than that of the glass lens. An image pickup device picks up an object image that has passed through the optical system as a defocused object image including an area with a large-depth-of-field light and a blurred area. An image processing device generates an image signal with a smaller blur than the blurred object image from the image pickup device.

FIELD OF THE INVENTION

Embodiments of the present invention relates generally to image pickup devices, and more particularly relates to image pickup devices usable for information code reading.

BACKGROUND

With the rapid development of digitalization of information, digitalization in image processing is increasingly required. In digital cameras in particular, solid-state image pickup devices, such as Charge Coupled Devices (CCD) and Complementary Metal Oxide Semiconductor (CMOS) sensors, have been provided mainly on imaging planes instead of films.

In image pickup apparatuses including CCDs or CMOS sensors, an image of an object is optically taken by an optical system and is extracted by an image pickup device in a form of an electric signal. In one image pickup apparatus, light is regularly dispersed by a phase plate and is reconstructed by digital processing to achieve a large depth of field.

Devices like CCD and CMOS sensors that have image input functions sometimes read close-up still images, such as bar codes, together with desired images, such as landscape images. Techniques used for reading bar codes include an auto-focus technique in which focusing is performed by moving a lens towards and away from the bar code and a depth expansion technique in which the depth of field is increased by reducing the F-number in a camera so as to achieve fixed focus.

In some image pickup apparatuses, a Point Spread Function (PSF) obtained is constant when the above-described phase plate is placed in the optical system. The PSF describes the response of an imaging system to a point source or point object. The degree of spreading (blurring) of the point object is a measure for the quality of an imaging system. If the PSF varies, it can be difficult to obtain an image with a large depth of field by convolution using a kernel.

Therefore, setting single focus lens systems aside, in lens systems like zoom systems and autofocus (AF) systems, high precision is required in the optical design, thereby increasing costs accordingly. In one automatic exposure control system for a digital camera, filtering process using a transfer function is performed. More specifically, in known image pickup apparatuses, a suitable convolution operation cannot be performed and the optical system should be designed to eliminate aberrations, such as astigmatism, coma aberration, and zoom chromatic aberration that cause a displacement of a spot image at wide angle and telephoto positions. However, eliminating the aberrations can increase the complexity of the optical design, the number of design steps, the costs, and the lens size.

In a depth expansion technique, although a desired depth of field can be achieved at normal temperature, the back-focus position changes depending on high temperature or low temperature, causing the focal point to vary. Furthermore, a temperature change can possibly cause the lens to become loose or crack. In addition, if a plastic lens has high power, the performance thereof can vary significantly in response to a temperature change, making it difficult to achieve a satisfactory image quality even by performing a restoring process. Moreover, the depth of field varies depending on the surrounding environment.

Accordingly, there is a need for an image pickup apparatus which can reduce the change in the characteristics of lenses, reduce the degradation of the lens characteristics due to high or low temperature, and reduce the degradation in characteristics of back focusing change.

SUMMARY

An image pickup apparatus operable to reduce defocusing due to temperature changes is disclosed. An optical system comprises one or more glass lens and one or more plastic lens, wherein the power of the plastic lenses is smaller than that of the glass lenses. An image pickup device picks up an object image that has passed through the optical system as a defocused object image including an area with a large-depth-of-field light and a blurred area. An image processing device generates an image signal with a smaller blur than the blurred object image received from the image pickup device.

A first embodiment comprises an image pickup apparatus. The image pickup apparatus comprises an optical system comprising one or more glass lenses and one or more plastic lenses, wherein a power of the plastic lenses is lower than a power of the glass lenses and a power of the optical system respectively. The image pickup apparatus further comprises an image pickup device operable to pick up an object image that has passed through the optical system as an out-of-focus dispersed object image comprising an area with a large-depth-of-field light and a blurred area. The image pickup apparatus also comprises an image processing device operable to generate an image signal with a smaller blur than that of a signal of a blurred object image output from the image pickup device.

A second embodiment comprises an information reading device. The information reading device comprises an image pickup apparatus operable to form an image, comprising an optical system comprising one or more glass lenses and one or more plastic lenses. A power of the plastic lenses is smaller than a power of the glass lenses and a power of the optical system. The image pickup apparatus further comprises an image pickup device operable to pick up an object image that has passed through the optical system as a dispersed object image which is out of focus thereon and comprise an area with a large-depth-of-field light and a blurred area. The image pickup apparatus also comprises an image processing device operable to generate an image signal with a smaller blur than that of a signal of a blurred object image output from the image pickup device. The information reading device further comprises a camera signal processor operable to receive the image from the image pickup apparatus.

A third embodiment comprises an image pickup apparatus. The image pickup apparatus comprises an optical system comprising one or more glass lenses and one or more plastic lenses, wherein the power of the plastic lenses is smaller than that of the glass lenses and that of the optical system. The image pickup apparatus further comprises image pickup means operable to pick up an object image that has passed through the optical system as a dispersed object image which is out of focus thereon and comprise an area with a large-depth-of-field light and a blurred area. The image pickup apparatus also comprises image processing means operable to generate an image signal with a smaller blur than that of a signal of a blurred object image output from the image pickup means.

DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS

The following detailed description is exemplary in nature and is not intended to limit the disclosure or the application and uses of the embodiments of the invention. Descriptions of specific devices, techniques, and applications are provided only as examples. Modifications to the examples described herein will be readily apparent to those of ordinary skill in the art, and the general principles defined herein may be applied to other examples and applications without departing from the spirit and scope of the invention. Furthermore, there is no intention to be bound by any expressed or implied theory presented in the preceding technical field, background, brief summary or the following detailed description. The present invention should be accorded scope consistent with the claims, and not limited to the examples described and shown herein.

Embodiments of the invention are described herein in the context of practical non-limiting applications, namely, information code reading. Embodiments of the invention, however, are not limited to such code reading applications, and the techniques described herein may also be utilized in other imaging applications. For example, embodiments may be applicable to microphotography.

As would be apparent to one of ordinary skill in the art after reading this description, these are merely examples and the embodiments of the invention are not limited to operating in accordance with these examples. Other embodiments may be utilized and structural changes may be made without departing from the scope of the exemplary embodiments of the present invention.

The following description is presented to enable a person of ordinary skill in the art to make and use the embodiments of the invention. Descriptions of specific devices, techniques, and applications are provided only as examples. Various modifications to the examples described herein will be readily apparent to those of ordinary skill in the art, and the general principles defined herein may be applied to other examples and applications without departing from the spirit and scope of the embodiments of the present invention. Thus, the embodiments of the present invention are not intended to be limited to the examples described herein and shown, but are to be accorded the scope consistent with the claims.

FIG. 1is a schematic diagram illustrating a structure of an image pickup apparatus and traces of light ray bundles. The image pickup apparatus1comprises an optical system2and an image pickup device3. The image pickup device3may be a semiconductor sensor such as a CCD and a CMOS sensor.

The optical system2includes object-side lenses21and22, an aperture stop23, and an imaging lens24arranged in order from an object side (OBJS) toward the image pickup device3.

Referring toFIG. 1, in the image pickup apparatus1, the best-focus plane coincides with the plane on which the image pickup device is located.FIG. 2A to 2Cillustrate spot images formed on a light-receiving surface of an image pickup device3in the image pickup apparatus1shown inFIG. 1when a focal point is displaced by 0.2 mm (Defocus=0.2 mm), when the focal point is not displaced (Best focus) or when the focal point is displaced by −0.2 mm (Defocus=−0.2 mm), individually.

FIG. 3illustrates an outer appearance view showing one example of an information code reading device serving as an electronic device according to an embodiment of the present invention.FIGS. 4A to 4Care views showing an example of an information code.FIG. 5is a block diagram showing a configuration example of an information code reading device applicable to the information code reading device ofFIG. 1.

As shown inFIG. 3, the information code reading device100according to the present embodiment includes a main body110which is connected with a processing device such as an electronic register (not shown) by way of a cable111. The information code reading device100is capable of reading an information code121such as a symbol and a code having different reflectivity printed on a reading object120and the like.

The information code to be read may be a one-dimensional barcode122such as the JAN code shown inFIG. 4A, or a two-dimensional barcode123such as a stack-type CODE49shown inFIG. 2Bor a matrix type QR code shown inFIG. 2C.

According to an embodiment of the invention, the main body110of the information code reading device100(device100) includes a light source (not shown) and an imaging device200shown inFIG. 5. The image pickup device1includes a wavefront-aberration control optical system having a light wavefront modulation element provided in an optical system. In device100, a light beam is orderly dispersed by the light wavefront modulation element and is restored by digital processing, whereby an image with a large depth of field can be picked up.

The wavefront-aberration control optical system may be called a Depth Expansion Optical System which results in a highly accurate and adequate reading of information codes such as one-dimensional barcode122such as the JAN code shown inFIG. 4A, or a two-dimensional barcode123such as a stack-type CODE49or a matrix type QR code.

As shown inFIG. 5, the imaging device200includes an optical system210and an image pickup device220(imaging element220). The imaging device200further includes an analog front end unit (AFE)230, an image processing device240, a camera signal processing unit250, an image display memory260, an image monitoring device270, an operation unit280, and a control device290.

FIG. 6shows a basic configuration example of an imaging lens unit included in the optical system.

The optical system210A provides an image of an object OBJ to the image pickup device220. The optical system210A includes a first lens211, a second lens212, an aperture stop113, a third lens214and a fourth lens215. The first lens211, the second lens212, the aperture213, the third lens214and the fourth lens215locate in this order from the object side. The third lens214and the fourth lens215may be joined. That is, the optical system210may include a compound lens.

In the embodiment shown inFIG. 6, the first lens211, the third lens214and the fourth lens215are composed of, but not limited to glass and the second lens212is composed of, but not limited to plastic. Since plastic has a greater linear expansion coefficient than glass and reacts sensitively to a temperature change, controlling the power of a plastic lens allows for favorable performance from low temperature to high temperature, thereby alleviating the effect of temperature change on the depth of field in a depth expansion optical system.

The optical system210A includes one or more plastic lenses and one or more glass lenses. The total power of the plastic lenses is positive. A lens frame includes the first holder and a second holder, and may also include an intermediate member. By adjusting the fixed positions of the first holder and the second holder or the linear expansion coefficients of the two holders, back-focus shift occurring in response to a temperature change can be alleviated. With this adjustment, deviation in the back-focus position can be controlled, thereby allowing for sufficient performance that can satisfy various needs from a low-temperature environment to a high-temperature environment. Moreover, a temperature change affecting the depth of field in a depth expansion optical system can be alleviated.

The power of the plastic lens may be set such that the total focal length thereof is about 15.0 mm or more.

Specifically, in the optical system, the total focal length of the plastic lens may be infinite. In other words, the power of the plastic lens may be set close to zero so as to alleviate the amount of power fluctuation of the plastic lens occurring in response to a temperature change.

The power of the plastic lens (i.e., the second lens) is set lower than the power of the glass lenses (i.e., the first, third, and fourth lenses), and is also set lower than the power of the optical system.

The linear expansion coefficient of a portion (e.g., the holders supporting the image pickup device) holding the lenses of the optical system may be lower than the linear expansion coefficient of the plastic lens.

In the optical system210A, the light wavefront modulation element may be provided separately from the lenses or may be provided in the lenses. For example, the second lens may additionally have a light wavefront modulating function. A central region, centered on the optical axis (z inFIG. 6), of a face of the second lens closer to the image pickup face has a concave shape with predetermined curvature. With this concave shape, the second lens functions as a light wavefront modulation element.

FIG. 7illustrates a defocused state of an analog spot image obtained using a plastic lens with high negative power.FIG. 8illustrates a defocused state of an analog spot image obtained using a plastic lens with high positive power.FIG. 9illustrates a defocused state of an analog spot image obtained using a plastic lens with reduced power.

As shown inFIGS. 7 and 8, an analog spot image obtained using a plastic lens with high negative or positive power varies depending on normal temperature, high temperature, and low temperature. Therefore, satisfactory performance cannot be achieved.

In contrast, when the power of a plastic lens is lower than the power of a glass lens, and is also lower than the power of the optical system such as the optical system in the present embodiment, sufficient performance that can satisfy various needs from a low-temperature environment to a high-temperature environment is achieved as shown inFIG. 9. Moreover, a temperature change affecting the depth of field in a depth expansion optical system can be alleviated.

In the optical system210A, the shape of the aspheric surface of the lens is expressed with the following aspheric surface equation with making the direction from the object side towards the image plane side positive, k as a conical coefficient, A, B, C, and D as aspheric surface coefficients, and r as a center curvature radius.

Furthermore, h represents the height of the light beam and c represents the inverse number of the center curvature radius, Z represents the depth from the tangent plane with respect to the plane vertex. Specifically, A is the aspheric surface coefficient of fourth order, B is the aspheric surface coefficient of sixth order, C is the aspheric surface coefficient of eighth order, and D is the aspheric surface coefficient of tenth order. Moreover, α and β are phase plane coefficients, and x and y are directions shown inFIG. 4.

In the optical system210A (i.e. image pickup lens unit) shown inFIG. 6, an object-side face1of a first lens211is set to have a center radius of curvature of R1, and an image-side face2of the first lens211is set to have a center radius of curvature of R2. An object-side face3of a second lens212is set to have a center radius of curvature of R3, and an image-side face4of the second lens212is set to have a center radius of curvature of R4. An object-side face5of a third lens214is set to have a center radius of curvature of R5, and an image-side face5of the third lens212is set to have a center radius of curvature of R5. An image-side face7of a fourth lens215is set to have a center radius of curvature of R7, and a fourth-lens-side face8of the cover glass221is set to have a center radius of curvature of R8and a image-side face9of the cover glass221is set to have a center radius of curvature of R9. In this embodiment, R8and R9are zero without limitation.

The first lens211is set to have a refractive index of η1and a dispersion value of ν1. The second lens212is set to have a refractive index of η2and a dispersion value of ν2. The third lens214is set to have a refractive index of η3and a dispersion value of ν3. The fourth lens215is set to have a refractive index of η4and a dispersion value of ν4.

The image pickup device220is located such that a plane-parallel plate221(cover glass) composed of glass and an image pickup face222of the image pickup device220such as CCD or CMOS sensor are arranged in that order from a fourth lens. Light from an object OBJ via the image pickup optical system210forms an image on the image pickup face222of the image pickup device220.

A dispersed object image picked up by the image pickup device220is out of focus on the image pickup device220and includes an area with a large-depth-of-field light beam and a blurred area. By additionally performing a filtering process in an image processing device240, the resolution of the distance between two objects can be corrected.

The image pickup device220may include a CCD or a CMOS sensor on which the image received from the optical system210is formed and which outputs first image information representing the image formed thereon to the image processing device240via the AFE unit230as a first image electric signal (FIM). In the embodiment shown inFIG. 3, a CCD is shown as an example of the image pickup device120.

The AFE unit230may include a timing generator231and an analog/digital (A/D) converter232. The timing generator231generates timing for driving the CCD in the image pickup device220. The A/D converter232converts an analog signal input from the CCD into a digital signal, and can output the thus-obtained digital signal to the image processing device240.

The image processing device240(e.g., a digital signal processor (DSP)) can receive the digital signal representing the picked-up image from the AFE unit230, subject the signal to a two-dimensional convolution process, and output the result to the camera signal processor250. The image processing device240is operable to perform a filtering process of the optical transfer function (OTF) on the basis of exposure information obtained from the controller290. The exposure information may include, without limitation, aperture information.

The image processing device240comprise a function of enhancing the response of an optical transfer function with respect to multiple images picked up by the image pickup device220and performing a filtering process (such as a convolution filtering process) to eliminate a change in the optical transfer function in accordance with an object distance. While being dependent on a plurality of object distances, the image processing device can allow for a large depth of field. The image processing device240generates an image signal with a smaller blur than that of a signal of a blurred object image output from the image pickup device220.

In addition, the image processing device240is operable to perform noise-reduction filtering at a first step. The image processing device240can also perform a filtering process of the optical transfer function (OTF) and improving the contrast.

The camera signal processor (DSP)250is operable to perform, without limitation, processes including color interpolation, white balancing, YCbCr conversion, compression, filing, etc., stores data in the memory260, and displays images on the image monitoring device270.

The controller290is operable to perform exposure control, receive operation inputs from the operating unit280and the like, and determine the overall operation of the system on the basis of the received operation inputs. Thus, the controller190can control the AFE unit230, the image processing device240, DSP250, the aperture stop213, and the like, so as to perform arbitration control of the overall system.

The lens frame includes the first holder that holds the lenses in the optical system210and the second holder that holds the image pickup device220. The first holder and the second holder are fixed to each other.

The thermal expansion/contraction amount of the distance from an image-pickup-element-side face of the final lens (i.e., the fourth lens inFIG. 6) of the optical system210, which is located closest to the image pickup device220, to the image pickup device220can be adjusted by two methods. One method is setting the linear expansion coefficient of the second holder and the other method is changing the fixed positions of the first holder and the second holder.

The both methods will be described below with the description of the detailed configuration of the lens frame.

FIGS. 10 and 11illustrate exemplary lens frames according to one embodiment of the invention. As shown inFIGS. 10 and 11, the lens frames300and300A include the first holder310and the second holder320as separate components. The first holder310and the second holder320are fixed by means of an intermediate member330. The first holder310and the second holder320may have different linear expansion coefficients. Specifically, the linear expansion coefficient of the first holder310is greater than the linear expansion coefficient of the second holder320. With controlling the coefficients of the holders, deviation in the back-focus position can be controlled, thereby allowing for sufficient performance that can satisfy various needs from a low-temperature environment to a high-temperature environment. Moreover, a temperature change affecting the depth of field in a depth expansion optical system can be alleviated.

The first holder supports a plurality of lenses, and may be located at a first distance on an optical axis (z inFIG. 6) of the optical system210. The first holder310may be cylindrical and includes a first holding section311that holds the first lens211, a second holding section312that holds the second lens212, a third holding section313that holds the third lens214, and a fourth holding section314that holds the fourth lens215.

The outer side of the first holder310is fixed to one end of the intermediate member330at the object side of the first holder310relative to the middle thereof in the axial direction by using, without limitation, an adhesive340. The first holder310is composed of plastic without limitation.

The second holder320supports the image pickup device220, and is located at a second distance on the optical axis (z inFIG. 6). The second holder320is a cylinder with an outside diameter larger than that of the first holder310. The central portion of the second holder320has an opening extending in the axial direction. The second holder320has the image pickup device220fixed to the bottom face321(i.e., a first face) thereof.

The other end331of the intermediate member330is fixed to the top face322(i.e., an object-side face) of the second holder320by using, for example, an adhesive. The second holder320is composed of plastic without limitation.

The intermediate member330is a cylinder comprising an inside diameter larger than the outside diameter of the first holder310. The one end331of the intermediate member330has an adhesive receiver332extending circumferentially along the inner surface thereof and used for receiving an adhesive340injected when fixing the first holder310.

The other end of the intermediate member330is provided with a flange333that extends inward. The outer face (i.e., the bottom face) of this flange333is fixed in contact with the top face322of the second holder320.

The intermediate member330is composed of a metallic material comprising a low linear expansion coefficient, such as aluminum.

Although the second holder320and the first holder310in the lens frame300are fixed to each other in this manner so that the optical system is in a fixed focus state, back-focus positional shift caused by a temperature change can be alleviated without requiring a driving mechanism by varying the linear expansion coefficients of the material of the first holder310and the material of the second holder320.

By setting the linear expansion coefficient of the intermediate member330lower than the linear expansion coefficients of the first holder310and the second holder320, the amount of relative positional shift among the lenses in the lens frame300can be minimized in the optical system in which, for example, back-focus positional shift of the lens unit due to the temperature is small and the back-focus is sufficiently long.

Thus, the first holder310at a first distance and the second holder320at a second distance are at predetermined locations based on the power of the plastic lenses.

Furthermore, when the total power of the plastic lens included in the optical system210is positive, the distance between the image-pickup-element-side face of the fourth lens215, which is the final lens, and the image pickup device220becomes longer at high temperature and shorter at low temperature, relative to the normal temperature.

The first holder310is fixed to the intermediate member330at the object side of the first holder310relative to the middle thereof in the axial direction.

Accordingly, in an embodiment, fluctuation of the plastic lens due to the temperature change can be minimized by reducing the power of the plastic lens at the time of designing the lens. In addition, by forming the first holder310and the second holder320as separate components and giving the two holders different linear expansion coefficients, performance deterioration occurring from back-focus shift due to the temperature change can be minimized.

The following description relates to temperature-aware design of the second holder320and the first holder310composed of different materials.

Supposing that the lens frame is not designed in view of the temperature, if the frame is composed of plastic, the back-focus position will undesirably extend at high temperature.

Furthermore, because the refractive index of the lenses decreases at high temperature, if the plastic lens, which is especially influential, has negative power, the lens power can decrease, causing the back-focus position to shift towards the shorter side. In other words, the lens frame and the lenses change in temperature towards an unfavorable state.

Therefore, if the second holder320is composed of plastic, the plastic lens of the lens unit may have positive power.

If the plastic lens has positive power in this manner, the lens power decreases at high temperature, causing the back-focus position to shift towards the longer side. Therefore, the distance from the image-pickup-element-side face of the final lens to the image-pickup-element face may increase at high temperature due to the expansion of the lens frame.

How the back-focus positional shift is adjusted if the plastic lens has positive power, is described below according to an embodiment of the invention.

The example shown inFIG. 10shows how fluctuation of the lens frame is alleviated when the plastic lens has negative power.

Supposing that a temperature compensation barrel is at high temperature, an arrow <1> denotes the direction and the magnitude when the second holder320expands on the basis of the image-pickup-element face, an arrow <2> denotes the direction and the magnitude when the intermediate member330expands on the basis of the reception of the second holder320, and an arrow <3> denotes the direction and the magnitude when the intermediate member330expands on the basis of the attached position.

Since the second holder320is composed of plastic, the back-focus extends toward the object. Due to being composed of aluminum, which has a linear expansion coefficient lower than that of plastic, the intermediate member330has an expansion rate lower than the expansion rate of the first and second holders310,320. The first holder310composed of plastic expands toward the image pickup device220on the basis of the attached position. Thus, the plastic first holder310expands toward the image pickup device220.

Accordingly, with the combination of the lens frame components composed of materials having different linear expansion coefficients, the distance from the final lens face to the image-pickup-element face can be shortened by the lens frame even at high temperature, thereby reducing back-focus shift caused by the temperature.

In contrast, if the plastic lens has positive power, the lens power decreases at high temperature, causing the back-focus position to shift towards the longer side. Therefore, the distance from the image-pickup-element-side face of the final lens, which is the fourth lens in this case, to the image-pickup-element face may increase at high temperature due to the expansion of the lens frame. The example shown inFIG. 11shows how fluctuation of the lens frame is alleviated when the plastic lens has positive power.

Supposing that a temperature compensation barrel is at high temperature, arrows <1>, <2> and <3> denotes the same inFIG. 10.

Since the holder320is made of plastic, the back-focus expands towards the object side on the basis of the image pickup device220face (see <1>).

In the example shown inFIG. 11, the linear expansion of the first holder is adjusted in the direction of the arrow <2> so as to link with back-focus shift, thereby preventing back-focus shift even at high temperature. For example, since the amount of back-focus shift is reduced if the power of the plastic lens is positive and low, metal with a low linear expansion coefficient, such as aluminum, may be used.

In contrast, since the back-focus position is significantly extended at high temperature if the plastic lens has dominantly high positive power, the second holder may be composed of plastic with a high linear expansion coefficient.

Accordingly, with the combination of the lens frame components composed of materials having different linear expansion coefficients, the distance, which expands at high temperature, from the image-pickup-element-side face of the final lens to the image-pickup-element face220can be adjusted appropriately, thereby reducing back-focus shift caused by the temperature.

The plastic used for forming the first holder is, without limitation, PCGF20 (having a linear expansion coefficient of 0.000065). Although the first holder comprise aluminum or plastic, the linear expansion coefficient thereof may be adjusted by combining two materials, such as, without limitation, glass in plastic.

An adhesive that can be cured by irradiating it with ultraviolet light may be used. With the use of such an adhesive, the first holder (barrel) can be fixed after freely adjusting it (for example, after adjusting it also in a direction not parallel to the optical axis). This fixation may be implemented by fitting a projection provided in one of the first holder and the intermediate member into a recess provided in the other one of the two. With such a mechanical fixation method, the effect of age deterioration of an adhesive can be minimized.

FIGS. 12 to 14illustrate methods for fixing the lens frame according to one embodiment of the invention. In the embodiment, the300B,300C and300D inFIGS. 12 to 14are used for a frame structure. Lens supporting unit310and image pick up element supporting unit320are supported and fixed by an intermediate portion330. The locations of lens supporting unit310and image pick up element supporting unit320are adjustable with using the intermediate portion330. The adjustment of these locations can maintain the characteristics of the image pickup device220even though the temperature is varied from low temperature to high temperature for a wide variety of needs. Furthermore, in WFCO (Wavefront Coding Optical System), the effect of temperature change on the depth of field will be alleviated.

In the present embodiment, the distance from an image-pickup-element-side face7of the final lens (i.e., the fourth lens215inFIG. 6), which is located closest to the image pickup device220of the optical system210, to the image pickup device220is change by temperature change. An amount of the change is adjustable by changing the fixed position of the first holder310and the second holder320.

The first holder310may have a cylindrical shape and includes a first holding section311that holds the first lens211, a second holding section312that holds the second lens212, a third holding section313that holds the third lens214, and a fourth holding section314that holds the fourth lens215. The first holder310may be composed of plastic without limitation.

The second holder320may have a cylindrical shape with an outside diameter larger than that of the first holder310. The central portion of the second holder320has an opening extending in the axial direction. The second holder320has the image pickup device220fixed to the bottom face321(i.e., a first face) thereof.

The one end of the intermediate member330is fixed to the top face322(i.e., an object-side face) of the second holder320by using, without limitation, an adhesive. The second holder320is composed of plastic without limitation.

The intermediate member330is a cylinder with an outside diameter larger than that of the first holder310. A sidewall334of the intermediate member330is provided with a plurality (i.e. three in case of the present embodiment) of fixation sections335to337each formed of through holes that are arranged at predetermined intervals in the axial direction. Specifically, the fixation sections335to337are arranged at predetermined intervals in the circumferential direction.

The other end of the intermediate member330is provided with a flange338that extends inward. The outer face (i.e., the bottom face) of this flange338is fixed in contact with the top face322of the second holder320.

The intermediate member330comprises, without limitation, a plastic or a metallic material having a low linear expansion coefficient, such as aluminum.

The second holder320and the first holder310in the lens frame300B,300C and300D are fixed to each other so that the optical system210is in a fixed focus state, and thereby alleviating back-focus positional shift caused by a temperature change without requiring a driving mechanism.

Without changing the back-focus position at normal temperature, the lens unit can be made to cover from high temperature to low temperature by adjusting the fixed positions of the first holder310and the second holder320.

In the image pickup apparatus300B and300C shown inFIGS. 12 to 14, when the total power of the plastic lens included in the optical system210is positive, the distance between the image-pickup-element-side face of the fourth lens215, which is the final lens, and the image pickup device220becomes longer at high temperature and shorter at low temperature, relative to the normal temperature.

Accordingly, in this embodiment, fluctuation of the plastic lens due to the temperature change can be minimized by reducing the power of the plastic lens at the time of designing the lens. In addition, by forming the first holder310and the second holder320as separate components and making the fixed positions of the first holder310and the second holder320adjustable with using the intermediate member330, performance deterioration occurring from back-focus shift due to the temperature change can be minimized.

In a mechanism of the lens frames300B,300C and300D comprising three adjustable fixed positions shown inFIGS. 12 to 14, it is supposed that the first holder310and the second holder320have similar linear expansion coefficients.

When the plastic lens included in the optical system has low positive power, the distance from the image-pickup-element-side face (i.e., the final lens face) to the image pickup device220, for example, increases at high temperature in accordance with the linear expansion coefficients of the materials used for the holders. However, the amount of back-focus shift is small when the plastic lens in the lens unit has low power.

When a fixed position like <1> (fixation section335) is near the top lens face as shown inFIG. 14, the back-focus shift can be cancelled out.

In contrast, when the total power of the plastic lens is positive and high, the back-focus is extended at high temperature in the lens frame, resulting in lower positive power for the lens and longer back-focus. In that case, the fixed position may be shifted to position <3>, as shown inFIG. 13. By shifting the fixed position to position <3>, the distance from the final lens face to the image pickup device220is not cancelled out.

The following description relates to temperature-aware design with adjustable fixed positions.

In the mechanism of the lens frame comprising three adjustable fixed positions, as shown inFIG. 12 to 14, the lenses are designed such that satisfactory performance can be maintained at position <2> within a temperature range from normal temperature to a certain temperature. The distance between the fourth lens face, which is the final lens face, and the image-pickup-element face is appropriately shortened on the basis of the fixed position even at high temperature. However, when the total power of the plastic lens is positive and high, the back-focus position is extended at high temperature with respect to the lens frame, and the positive power of the lens becomes lower and the back-focus becomes longer. In that case, as shown inFIG. 13, the fixed position may be set at position <3>. By setting the fixed position at position <3>, the distance from the final lens face to the image pickup device220is not cancelled out.

If the total power of the plastic lens is negative and high, the back-focus is extended at high temperature with respect to the lens frame, and the negative power of the lens becomes lower and the back-focus becomes shorter. In that case, the fixed position may be at position <1> (fixation section335), as shown inFIG. 14. By shifting the fixed position to position <1>, the distance from the final lens face of the fourth lens215to the image pickup device220is cancelled out and will be shorter.

Referring toFIG. 12, the plastic used for forming the first holder310is, without limitation, PCGF20 (having a linear expansion coefficient of 0.000065). The first holder310may be composed of plastic mixed with glass, thereby controlling the linear expansion coefficient thereof.

An adhesive that can be cured by irradiating it with ultraviolet light may be used in the present embodiment. A fixation method by screwing can also be used.

With the use of such an adhesive, the first holder (barrel) can be fixed after freely adjusting it (for example, after adjusting it also in a direction not parallel to the optical axis). With such a mechanical fixation method using screws, the effect of age deterioration of an adhesive can be minimized.

The lenses and the image pickup device220having the above-described configuration can be, without limitation, assembled together in accordance with a procedure shown inFIG. 15.

In step ST301, the lenses in the optical system including glass and plastic lenses are set in the first holder310. The first lens211, second lens212, third lens214, and fourth lens215are arranged in the first holder310in that order from the object side.

In step ST302, the image pickup device220is set in the second holder320. The order of ST301and ST302can be inverted.

In step ST303, the image-pickup-element-side face of the fourth lens215, which is the final lens located closest to the image pickup device220, and a light-receiving face of the image pickup device220are located facing each other.

The process performed in step ST303is associated with an embodiment shown inFIGS. 12 to 14.

In step ST304, the first holder310and the second holder320are selectively fixed, by using the intermediate member330, to positions where they can relatively absorb back-focus positional shift occurring in response to a temperature change.

Alternatively, as a process associated with an embodiment shown inFIGS. 10 and 11, the fixed positions of the first holder310and second holder320or the materials (linear expansion coefficients) of the first holder310and the second holder320may be selected so that they are fixed to positions where they can relatively absorb back-focus positional shift occurring in response to a temperature change.

When the total power of the plastic lens included in the optical system is positive in the step ST304, the first holder310and the second holder320are selectively fixed so that the distance between the image-pickup-element-side face of the fourth lens215, which is the final lens located closest to the image pickup device220, and the image pickup device220becomes longer at high temperature and shorter at low temperature, relative to the normal temperature.

In the optical system described above, the amount by which the distance between the image-pickup-element-side face of the final lens located closest to the image pickup device220and the image pickup device220increases or decreases due to heat accords with the amount by which back-focus is shifted in response to a temperature change in the optical system.

The following relates to practical examples 1 and 2 of specific numerical values in the optical system (i.e. image pickup lens unit)210A. In the following examples 1 and 2, the first lens211, third lens214, and fourth lens215are composed of glass, whereas the second lens212is composed of plastic. The power of the plastic lens is set lower than the power of the glass lenses, and is also set lower than the power of the optical system210A.

In each example, the lenses constituting the lens groups of an image pickup lens unit210A and the cover glass constituting the image pickup device220are given numbers, as shown inFIG. 6.

Tables 1 and 2 shows numerical values for example 1. These numerical values correspond to the image pickup lens unit210A shown inFIG. 6. The first-lens focal length is −4.73, the second-lens focal length is 5.47, and the third-and-fourth-compound-lens focal length is 4.20. Table 1 shows the radius of curvature (R: mm), the distance (D: mm), the refractive index (N), and the dispersion value (ν) for each of a lens stop, the lenses, and the cover glass that correspond to the face numbers of the image pickup lenses in the example 1.

Table 2 shows aspherical coefficients of predetermined faces of the first lens211, the second lens212, the third lens214and the fourth lens215which include aspheric surfaces. In Table 2, k denotes a conic constant, and A, B, C, and D respectively denote fourth-order, sixth-order, eighth-order, and tenth-order aspherical coefficients. Moreover, α and β denote phase front coefficients, and x and y denote directions shown inFIG. 6. Specifically, the face4has α of −0.00165 and β of 0.0217.

Table 3 and 4 shows numerical values for example 2. These numerical values correspond to the image pickup lens unit210B shown inFIG. 16. The first-lens focal length is 17.0, the second-lens focal length is −22.0, and the third-and-fourth-compound-lens focal length is 4.73. Table 3 shows the radius of curvature (R: mm), the distance (D: mm), the refractive index (N), and the dispersion value (ν) for each of a lens stop, the lenses, and the cover glass that correspond to the face numbers of the image pickup lenses in the example 2.

Table 4 shows aspherical coefficients of predetermined faces of the first lens211B, the second lens212B, the third lens214B and the fourth lens215B which include aspheric surfaces. In Table 4, k denotes a conic constant, and A, B, C, and D respectively denote fourth-order, sixth-order, eighth-order, and tenth-order aspherical coefficients. Moreover, α and β denote phase front coefficients, and x and y denote directions shown inFIG. 16. Specifically, the face4has α of −0.00165 and β of 0.0217.

Tables 5 and 6 show an example of refractive-index fluctuation occurring due to a linear expansion coefficient.

The refractive-index fluctuation of plastic is greater than that of glass with the temperature range in Table 6. When the second lens212B is composed of plastic, since the second lens power in the example 2 is reduced, back-focus positional shift due to the temperature change can still be alleviated even if refractive-index fluctuation occurs due to the temperature change.

Accordingly, in the image pickup lens unit shown in examples 1 and 2, high image-forming performance can be achieved.

In the image pickup lens unit, the plastic lens and the glass lenses are included, the total power of the plastic lens is positive, and the fixed positions of the first and second holders or the linear expansion coefficients of the materials used for forming the first holder and the second holder are adjusted in the examples 3 to 5 as follows.

The lenses211,212,214and215constituting the lens groups of the image pickup lens unit210A and the cover glass221constituting the image pickup device220in example 3 are given the face numbers, as shown inFIG. 6.

The optical system (i.e. image pickup lens unit)210C shown inFIG. 17includes first to fifth lenses and a lens stop in examples 4 and 5. The optical system210C shown inFIG. 17includes the first lens211C, the second lens212C, the third lens213C, the lens stop214C, the fourth lens215C, and the fifth lens216C. Specifically, the first lens211C, the second lens212C, the third lens213C, the lens stop214C, the fourth lens215C, and the fifth lens216C in the optical system210C are arranged in that order from the object side.

The fourth lens215C and the fifth lens216C in the optical system210C are joined. That is, the optical system210may include a compound lens. The first lens211C, the second lens212C, the fourth lens215C and the fifth lens216C are composed of glass and the third lens213C is composed of plastic.

In the optical system210C, the light wavefront modulation element is provided separately from the lenses. However, the third lens213C, for example, may additionally have a light wavefront modulating function.

A central region213a, centered on the optical axis, of a face of the third lens closer to the image pickup face has a concave shape with predetermined curvature. With this concave shape, the third lens213C functions as a light wavefront modulation element.

In the optical system210C, an object-side face of the first lens211C is set to have a center radius of curvature of R1, and an image-side face of the first lens211C is set to have a center radius of curvature of R2. An object-side face of the second lens212C is set to have a center radius of curvature of R3, and an image-side face of the second lens212C is set to have a center radius of curvature of R4. An object-side face of the third lens213C is set to have a center radius of curvature of R5, and an image-side face of the third lens213C is set to have a center radius of curvature of R6. An object-side face of the fourth lens215C is set to have a center radius of curvature of R7, and an image-side face of the fourth lens215C is set to have a center radius of curvature of R8. An object-side face the fifth lens216C is set to have a center radius of curvature of R9.

The first lens211C is set to have a refractive index of η1and a dispersion value of ν1, the second lens212C is set to have a refractive index of η2and a dispersion value of ν2, third lens213C is set to have a refractive index of η3and a dispersion value of ν3, the fourth lens215C is set to have a refractive index of η4and a dispersion value of ν4, and the fifth lens216C is set to have a refractive index of η5and a dispersion value of ν5.

Tables 7 and 8 shows numerical values for example 3. These numerical values correspond to the image pickup lens unit210A shown inFIG. 6. The first-lens focal length is −4.73, the second-lens focal length is 5.47 which is a plastic lens, and the third-and-fourth-compound-lens focal length is 4.19. Table 7 shows the radius of curvature (R: mm), the distance (D: mm), the refractive index (N), and the dispersion value (ν) for each of a lens stop, the lenses, and the cover glass that correspond to the face numbers of the image pickup lenses in the example 3.

Table 8 shows aspherical coefficients of predetermined faces of the first lens211, the second lens212, the third lens214and the fourth lens215which include aspheric surfaces. In Table 8, k denotes a conic constant, and A, B, C, and D respectively denote fourth-order, sixth-order, eighth-order, and tenth-order aspherical coefficients. Moreover, α and β denote phase front coefficients, and x and y denote directions shown inFIG. 16. Specifically, the face4has α of −0.00165 and β of 0.0217.

Tables 9 and 10 show an example of refractive-index fluctuation occurring due to a linear expansion coefficient.

The refractive-index fluctuation of plastic is greater than that of glass with the temperature range in Table 10. When the second lens212is composed of plastic, since the second lens power in the example 3 is reduced, back-focus positional shift due to the temperature change can still be alleviated even if refractive-index fluctuation occurs due to the temperature change.

Tables 11 and 12 shows numerical values for example 4. These numerical values correspond to the image pickup lens unit210C shown inFIG. 17. The first-lens focal length is −9.33, the second-lens focal length is 16.02, the third-lens focal length is 25.15 and the fourth-and-fifth-compound-lens focal length is 6.18. Table 11 shows the radius of curvature (R: mm), the distance (D: mm), the refractive index (N), and the dispersion value (ν) for each of a lens stop, the lenses, and the cover glass that correspond to the face numbers of the image pickup lenses in the example 4.

Table 12 shows aspherical coefficients of predetermined faces of the first lens211C, the second lens212C, the third lens213C, the fourth lens215C and the fifth lens216C which include aspheric surfaces. In Table 12, k denotes a conic constant, and A, B, C, and D respectively denote fourth-order, sixth-order, eighth-order, and tenth-order aspherical coefficients.

Tables 13 and 14 shows numerical values for example 5. These numerical values correspond to the image pickup lens unit210C shown inFIG. 17. The first-lens focal length is −8.46, the second-lens focal length is 16.99, the third-lens focal length is 14.81 which is a plastic lens, and the fourth-and-fifth-compound-lens focal length is 6.92. Table 13 shows the radius of curvature (R: mm), the distance (D: mm), the refractive index (N), and the dispersion value (ν) for each of a lens stop, the lenses, and the cover glass that correspond to the face numbers of the image pickup lenses in the example 5.

Table 14 shows aspherical coefficients of predetermined faces of the first lens211C, the second lens212C, the third lens213C, the fourth lens215C and the fifth lens216C which include aspheric surfaces. In Table 14, k denotes a conic constant, and A, B, C, and D respectively denote fourth-order, sixth-order, eighth-order, and tenth-order aspherical coefficients.

Accordingly, in the image pickup lens unit shown in examples 3 to 5, high image-forming performance can be achieved.

FIGS. 18A to 18Dillustrate back-focus position shift occurring in response to a temperature change when the plastic lens has reduced power in example 4. The focal length of the plastic lens inFIG. 18Ais about 25.0 mm.FIG. 18Billustrates a center MTF at normal temperature.FIG. 18Cillustrates a center MTF at high temperature (of, for example, about 65 degrees).FIG. 18Dillustrates a center MTF at low temperature (of, for example, −20 degrees).

FIGS. 19A to 19Dillustrate back-focus position shift occurring in response to a temperature change when the plastic lens has not reduced power in example 5. The focal length of the plastic lens inFIG. 19Ais about 14.8 mm.FIG. 19Billustrates a center MTF at normal temperature.FIG. 19Cillustrates a center MTF at high temperature (of, for example, about 65 degrees).FIG. 19Dillustrates a center MTF at low temperature (of, for example, −20 degrees).

ComparingFIG. 18Ato D withFIGS. 19Ato D, the amount of back-focus shift decreases with decreasing power of the plastic lens. When the power of the plastic lens is set higher than a value equivalent to a focal length of about 15.0 mm, the back-focus changes significantly in response to a temperature change, resulting in significant performance deterioration. In particular, when this limit is exceeded with an F2.8 lens, the center MTF becomes inverted, resulting in spurious resolution.

In light of this, the power of the plastic lens is set such that the total focal length fplathereof is about 15.0 mm or more in the present embodiment as described above.

The structures and functions of the optical system210and the image processing device240according to the present embodiment will be described below.

Next, the filtering procedure performed by the image processing device240is explained.

According to this embodiment, an optical lens used is the one that regularly disperses light converged by an optical system210. A phase plate is inserted into the optical system210. Due to the phase plate, an image that is not in focus at any point thereof can be formed on the image pickup device220. In other words, the phase plate113aforms light with a large depth (which plays a major role in image formation) and flares (blurred portions).

A system for performing digital processing of the regularly dispersed image so as to reconstruct a focused image is called a wavefront-aberration-control optical system or WFCO (Wavefrong Coding Optical System). The function of this system is provided by the image processing device240.

In the present embodiment, a free-form surface acting as a light wavefront modulation element is formed on the image-pickup-element-side face of the second lens. However, any type of optical wavefront modulation element may be used as long as the wavefront shape can be changed. For example, an optical element having a varying thickness (e.g., a phase plate having an above-described three-dimensional curved surface), an optical element having a varying refractive index (e.g., a gradient index wavefront modulation lens), an optical element having a coated lens surface or the like so as to have varying thickness and refractive index (e.g., a wavefront modulation hybrid lens), a liquid crystal device capable of modulating the phase distribution of light (e.g., a liquid-crystal spatial phase modulation device), etc., may be used as the optical wavefront modulation element.

The principals of WFCO and wavefront modulation element are described in detail in U.S. application Ser. No. 11/755630 and PCT application JP2007/075204 entire contents of which are incorporated herein by reference in their entirety.

The structure of the image processing device240and the process of image processing are described below.

Referring toFIG. 5, the image processing device240includes a RAW buffer memory241, a two-dimensional convolution operator unit242, a kernel data storage ROM143that functions as memory means, and a convolution controller144.

The controller244is controlled by the controller290so as to turn on/off the convolution process, control the screen size, switch kernel data and so on.

As shown inFIGS. 23 to 25, the kernel data storage ROM243stores kernel data for the convolution process that are calculated on the basis of a Point Spread Function (PSF) provided in advance in each of the optical systems and acquires exposure information, which is determined when the exposure settings are made by the controller290, and the kernel data is selected through the convolution controller244. The exposure information includes aperture information.

In the embodiment shown inFIG. 23, kernel data A corresponds to an optical magnification of 1.5, kernel data B corresponds to an optical magnification of 5, and kernel data C corresponds to an optical magnification of 10.

In the embodiment shown inFIG. 24, kernel data A corresponds to an F number, which is the aperture information, of 2.8, and kernel data B corresponds to an F number of 4. The F numbers 2.8 and 4 are out of the above-described area where the wavefront aberration is 0.5λ or less.

In the embodiment shown inFIG. 25, kernel data A corresponds to an object distance of 100 mm, kernel data B corresponds to an object distance of 500 m, and kernel data C corresponds to an object distance of 4 m.

The process of detecting the exposure information, image processing operation unit and kernel/coefficient storage register are described in details in U.S. application Ser. No. 11/755630 and PCT application JP2007/075204 the content of which is incorporated by reference herein in its entirety.

FIG. 26shows an exemplary image processing device300in which the object distance information and the exposure information are used in combination.

As shown inFIG. 26, the image pickup apparatus400includes a convolution device401, a kernel/coefficient storage register402, and an image processing operation unit403.

The image processing operation unit403reads information regarding an approximate distance to the object and exposure information from an object-distance-information detection device500, and determines a kernel size and a coefficient for use in an operation suitable for the object position. The image processing operation unit403stores the kernel size and the coefficient in the kernel/coefficient storage register402. The convolution device401performs the suitable operation using the kernel size and the coefficient so as to reconstruct the image.

In the present embodiment, the object-distance-information detection device500which includes a distance-detecting censor can detect the distance from the main object, and the different image processing can be performed on the basis of the detected distance.

The above-described image processing is performed by the convolution operation. To achieve the convolution operation, a single common operation coefficient may be stored and a correction coefficient may be stored in association with the focal distance. In such a case, the operation coefficient is corrected using the correction coefficient so that a suitable convolution operation can be performed using the corrected operation coefficient. Alternatively, the following structures may also be used.

That is, a kernel size and an operation coefficient for the convolution operation may be directly stored in advance in association with the focal distance, and the convolution operation may be performed using the thus-stored kernel size and operation coefficient. Alternatively, the operation coefficient may be stored in advance as a function of focal distance. In this case, the operation coefficient to be used in the convolution operation may be calculated from this function in accordance with the focal distance.

More specifically, in the apparatus shown inFIG. 26, the following structure may be used.

The kernel/coefficient storage register402functions as conversion-coefficient storing means and stores at least two conversion coefficients corresponding to the aberration caused by the phase plate which corresponds to a plastic lens. The image processing operation unit403functions as coefficient-selecting means for selecting one of the conversion coefficients stored in the kernel/coefficient storage register402, based on the information generated by the object-distance-information detection device500.

Then, the convolution device401, which functions as converting means, converts the image signal using the conversion coefficient selected by the image processing operation unit403which functions as the coefficient-selecting means.

Alternatively, as described above, the image processing operation unit403functions as conversion-coefficient calculating means and calculates the conversion coefficient on the basis of the information generated by the object-distance-information detection device500which functions as the object-distance-information generating means. The thus-calculated conversion coefficient is stored in the kernel/coefficient storage register402.

Then, the convolution device401, which functions as the converting means, converts the image signal on the basis of the conversion coefficient obtained by the image processing operation unit403, which functions as the conversion-coefficient calculating means, and stored in the kernel/coefficient storage register402.

Alternatively, the kernel/coefficient storage register402functions as correction-value storing means and stores at least one correction value in association with the zoom position or the amount of zoom of the optical system210including zoom function. The correction value includes a kernel size of an object aberration image.

Then, the image processing operation unit403functions as correction-value selecting means and selects a correction value, which corresponds to the distance from the object, from one or more correction values stored in the kernel/coefficient storage register402, which functions as the correction-value storing means, on the basis of the information generated by the object-distance-information detection device500that functions as the object-distance-information generating means.

The convolution device401, which functions as the converting means, converts the image signal using the conversion coefficient obtained from the kernel/coefficient storage register402, which functions as the second conversion-coefficient storing means, and the correction value selected by the image processing operation unit403, which functions as the correction-value selecting means.

Although this embodiment described above is directed to an example where only a second lens212is a plastic lens, one of the lenses other than the second lens212may be a plastic lens. As another alternative, two or more lenses of the second to fourth lenses may be plastic lenses so long as the power of each of the plastic lenses is set lower than the power of each glass lens and the total power of the plastic lenses is set lower than the power of the optical system.

Furthermore, since the first lens211located at the object side and the fourth lens located at the image-pickup-element side can directly come into contact with an object or with outside air, these lenses may be glass lenses for the purpose of preventing scratches and corrosion. In that case, the plastic lenses are sealed within a space formed by the glass lenses and the lens barrel so as to be less affected by the surrounding environment.

A lens configuration other than the lens configuration comprising four or five lenses is also permissible. For example, a lens configuration having six or more lenses is also permissible.

Furthermore, the kernel size and the operation coefficient used in the convolution operation may be set to be variable, and a suitable kernel size and operation coefficient can be determined on the basis of the inputs from the operating unit280and the like. Accordingly, it is not necessary to take the magnification and defocus area into account in the lens design and the reconstructed image can be obtained by the convolution operation with high accuracy.

In addition, a natural image in which the object to be shot is in focus can be obtained without using a complex, expensive, large optical lens or driving the lens.

The image pickup apparatus200may be applied to a small, light, inexpensive WFCO for use in consumer appliances such as digital cameras and camcorders, and the like.

In addition, the structure of the optical system210can be simplified and the optical system210can be easily manufactured. Furthermore, the costs can be reduced.

In the case in which a CCD or a CMOS sensor is used as the image pickup device220, the resolution has a limit determined by the pixel pitch. If the resolution of the optical system is equal to or more than the limit, phenomenon like aliasing occurs and adversely affects the final image, as is well known.

Although the contrast is preferably set as high as possible to improve the image quality, a high-performance lens system is required to increase the contrast.

However, aliasing occurs, as described above, in the case in which a CCD or a CMOS sensor is used as the image pickup device220. In the known image pickup apparatus, to avoid the occurrence of aliasing, a low-pass filter composed of a uniaxial crystal system is additionally used. Although the use of the low-pass filter is correct, since the low-pass filter is made of crystal, the low-pass filter is expensive and is difficult to manage. In addition, when the low-pass filter is used, the structure of the optical system becomes more complex.

As described above, although images with higher definitions are demanded, the complexity of the optical system must be increased to form high-definition images in the known image pickup apparatus. When the optical system becomes complex, the manufacturing process becomes difficult. In addition, when an expensive low-pass filter is used, the costs are increased.

The kernel/coefficient storage register402is not limited to storing the kernel sizes and values in association the optical magnification, the F number, and the object distance information, as shown inFIGS. 20 to 22. In addition, the number of kernel data elements to be prepared is not limited to three.

The image pickup apparatus220according to an embodiment of the invention may be used, without limitation, in digital still cameras, video cameras, digital video units, personal computers, mobile phones, personal digital assistants (PDAs), image inspection apparatuses, industrial cameras used for automatic control, and the like.

The image pickup apparatus220according to an embodiment of the invention are applicable, without limitation, to information code readers such as bar code readers, other electronic devices and the like.

While at least one exemplary embodiment has been presented in the foregoing detailed description, the present invention is not limited to the above-described embodiment or embodiments. Variations may be apparent to those skilled in the art. In carrying out the present invention, various modifications, combinations, sub-combinations and alterations may occur in regard to the elements of the above-described embodiment insofar as they are within the technical scope of the present invention or the equivalents thereof. The exemplary embodiment or exemplary embodiments are examples, and are not intended to limit the scope, applicability, or configuration of the invention in any way. Rather, the foregoing detailed description will provide those skilled in the art with a template for implementing the exemplary embodiment or exemplary embodiments. It should be understood that various changes can be made in the function and arrangement of elements without departing from the scope of the invention as set forth in the appended claims and the legal equivalents thereof. Furthermore, although embodiments of the present invention have been described with reference to the accompanying drawings, it is to be noted that changes and modifications may be apparent to those skilled in the art. Such changes and modifications are to be understood as being included within the scope of the present invention as defined by the claims.