Patent Description:
In order to obtain a three-dimensional (3D) image or material information that is not detected by the human eye, an image sensor including both visible light pixels and infrared pixels, for example, a multi-spectral image sensor or a 3D image sensor, is being developed. However, when a silicon-based photoelectric conversion element is used, a signal conversion rate of an infrared pixel is low, and crosstalk of infrared light occurs due to a microlens, making it difficult to improve quality. <CIT> describes an image sensor comprising a light-splitting element array including a plurality of phase filters.

<CIT>, <CIT> and <CIT> describe further examples of metasurface lens.

One or more example embodiments provide image sensors having improved light utilization efficiency by using a color separating lens array capable of condensing infrared light separately and electronic devices including the image sensors.

Additional aspects will be set forth in part in the description which follows and, in part, will be apparent from the description, or may be learned by practice of example embodiments of the disclosure.

According to an aspect of the invention, there is provided an image sensor according to claim <NUM>.

The plurality of light condensing regions are configured to change the phase of the first wavelength light such that the first wavelength light passing through the plurality of light condensing regions may have a phase profile that reduces in a direction away from a center of the plurality of light condensing regions.

The area of each of the plurality of light condensing regions may be <NUM> to <NUM> times larger than the area of each of the plurality of first pixels.

The color separating lens array may be configured such that a phase of the second wavelength light passing through the color separating lens array has a constant phase profile.

The image sensor may further include an infrared filter disposed between the sensor substrate and the color separating lens array that face the plurality of first pixels in a vertical direction, the infrared filter being configured to block visible light.

The image sensor may further include a color filter disposed between the sensor substrate and the color separating lens array that face the plurality of second pixels in a vertical direction, the color filter being configured to block infrared ray.

The image sensor may further include a microlens disposed on the color filter.

The color separating lens array may include a first pixel corresponding region disposed to face the plurality of first pixels in a vertical direction and including a first nanopost, and a second pixel corresponding region disposed to face the plurality of second pixels in the vertical direction and including a second nanopost.

The first nanopost may be disposed in a center of the first pixel corresponding region, the second nanopost may be disposed in a center of the second pixel corresponding region, and a cross-sectional area of the first nanopost may be larger than a cross-sectional area of the second nanopost.

The plurality of light condensing regions may include a first wavelength light condensing region, the second wavelength light may include red light or blue light, the color separating lens array may include a second wavelength light condensing region configured to condense the second wavelength light to the plurality of second pixels, an area of the second wavelength light condensing region may be larger than an area of the plurality of second pixels, and the first wavelength light condensing region may partially overlap the second wavelength light condensing region.

The sensor substrate may include a plurality of third pixels configured to sense third wavelength light, and a plurality of fourth pixels configured to sense fourth wavelength light, the second wavelength light may be red light, the third wavelength light may be blue light, and the fourth wavelength light may be green light, and the color separating lens array may be further configured to change a phase of the second wavelength light incident on the color separating lens array such that the second wavelength light is condensed to the plurality of second pixels, change a phase of the third wavelength light incident on the color separating lens array such that the third wavelength light is condensed to the plurality of third pixels, and change a phase of the fourth wavelength light incident on the color separating lens array such that the fourth wavelength light is condensed to the plurality of fourth pixels.

The sensor substrate may include a plurality of third pixels configured to sense third wavelength light, and a plurality of fourth pixels configured to sense fourth wavelength light, the second wavelength light may be red light, the third wavelength light may be blue light, the fourth wavelength light may be green light, and the color separating lens array may be configured to change the phase of the first wavelength light and a phase of the fourth wavelength light that are incident on the color separating lens array such that combined light of the first wavelength light and the fourth wavelength light is condensed to the plurality of first pixels and the plurality of fourth pixels.

The image sensor may further include a color filter disposed on the plurality of fourth pixels, the color filter being configured to block infrared ray.

The image sensor may further include a color filter disposed on the plurality of first pixels, the color filter being configured to block visible light.

The color separating lens array may be configured to change a phase of the second wavelength light incident on the color separating lens array such that the second wavelength light is condensed to the plurality of second pixels, and change a phase of the third wavelength light incident on the color separating lens array such that the third wavelength light is condensed to the plurality of third pixels.

The plurality of light condensing regions may include a first wavelength light condensing region, the color separating lens array may include a plurality of second wavelength light condensing regions configured to respectively condense the second wavelength light on the plurality of second pixels, and an area of each of the plurality of second wavelength light condensing regions may be larger than that of the first wavelength light condensing region.

According to another aspect of an example embodiment, there is provided an electronic device including an image sensor according to claim <NUM>.

The plurality of light condensing regions may be configured to change the phase of the first wavelength light such that the first wavelength light passing through the plurality of light condensing regions has a phase profile that reduces in a direction away from a center of the plurality of light condensing regions.

The electronic device may further include an infrared filter disposed between the sensor substrate and the color separating lens array that face the plurality of first pixels in a vertical direction, the infrared filter being configured to block visible light.

The electronic device may further include a color filter disposed between the sensor substrate and the color separating lens array that face the plurality of second pixels, color filter being configured to block infrared ray.

The electronic device may further include a microlens disposed on the color filter.

The sensor substrate may include a plurality of third pixels configured to sense third wavelength light, and a plurality of fourth pixels may be configured to sense fourth wavelength light, the second wavelength light may be red light, the third wavelength light may be blue light, and the fourth wavelength light may be green light, and the color separating lens array may be configured to change a phase of the second wavelength light incident on the color separating lens array such that the second wavelength light is condensed to the plurality of second pixels, change a phase of the third wavelength light incident on the color separating lens array such that the third wavelength light is condensed to the plurality of third pixels, and change a phase of the fourth wavelength light incident on the color separating lens array such that the fourth wavelength light is condensed to the plurality of fourth pixels.

The sensor substrate may include a plurality of third pixels configured to sense third wavelength light, and a plurality of fourth pixels configured to sense fourth wavelength light, the second wavelength light may be red light, the third wavelength light may be blue light, and the fourth wavelength light may be green light, and the color separating lens array may be configured to change phases of the first wavelength light and the fourth wavelength light that are incident on the color separating lens array such that combined light of the first wavelength light and the fourth wavelength light is condensed on the plurality of first pixels and the plurality of fourth pixels.

The electronic device may further include a color filter disposed on the plurality of fourth pixels, the color filter being configured to block infrared ray.

The electronic device may further include a color filter disposed on the plurality of first pixels, the color filter being configured to block visible light.

The color separating lens array may be configured to change a phase of the second wavelength light incident on the color separating lens array such that the second wavelength light is condensed on the plurality of second pixels, and change a phase of the third wavelength light incident on the color separating lens array such that the third wavelength light is condensed on the plurality of third pixels.

Hereinafter, an image sensor including a color separating lens array and an electronic device including the image sensor will be described in detail with reference to accompanying drawings. The example embodiments of the disclosure are capable of various modifications and may be embodied in many different forms. In the drawings, like reference numerals denote like components, and sizes of components in the drawings may be exaggerated for convenience of explanation.

When a layer, a film, a region, or a panel is referred to as being "on" another element, it may be directly on/under/at left/right sides of the other layer or substrate, or intervening layers may also be present.

It will be understood that although the terms "first," "second," etc. may be used herein to describe various components, these components should not be limited by these terms. These components are only used to distinguish one component from another. These terms do not limit that materials or structures of components are different from one another.

It will be further understood that when a portion is referred to as "comprises" another component, the portion may not exclude another component but may further comprise another component unless the context states otherwise.

In addition, the terms such as ". unit", "module", etc. provided herein indicates a unit performing a function or operation, and may be realized by hardware, software, or a combination of hardware and software.

The use of the terms of "the above-described" and similar indicative terms may correspond to both the singular forms and the plural forms.

Also, the steps of all methods described herein may be performed in any suitable order unless otherwise indicated herein or otherwise clearly contradicted by context. Also, the use of all exemplary terms (for example, etc.) is only to describe technical detail, and the scope of rights is not limited by these terms unless the context is limited by the claims.

<FIG> is a schematic block diagram of an image sensor <NUM> according to an example embodiment. Referring to <FIG>, the image sensor <NUM> may include a pixel array <NUM>, a timing controller <NUM>, a row decoder <NUM>, and an output circuit <NUM>. The image sensor <NUM> may include a charge coupled device (CCD) image sensor or a complementary metal oxide semiconductor (CMOS) image sensor.

The pixel array <NUM> includes pixels that are two-dimensionally arranged in a plurality of rows and columns. The row decoder <NUM> selects one of the rows in the pixel array <NUM> in response to a row address signal output from the timing controller <NUM>. The output circuit <NUM> outputs a photosensitive signal, in a column unit, from a plurality of pixels arranged in the selected row. To this end, the output circuit <NUM> may include a column decoder and an analog-to-digital converter (ADC). For example, the output circuit <NUM> may include a column decoder and a plurality of ADCs arranged respectively for the columns in the pixel array <NUM> or one ADC arranged at an output end of a column decoder. The timing controller <NUM>, the row decoder <NUM>, and the output circuit <NUM> may be implemented as one chip or in separate chips. A processor for processing an image signal output from the output circuit <NUM> may be implemented as one chip with the timing controller <NUM>, the row decoder <NUM>, and the output circuit <NUM>.

The pixel array <NUM> includes a plurality of pixels that sense light of different wavelengths, and in particular, includes an infrared pixel that senses light in an infrared band. An image sensor including the infrared pixel may perform various functions such as distance measurement, iris recognition, and night vision, and an arrangement of pixels including the infrared pixel may be implemented in various ways. For example, <FIG> show various pixel arrangements of the pixel array <NUM> of the image sensor <NUM>.

<FIG> shows an arrangement in which one of green pixels G in a Bayer pattern that is generally adopted in the image sensor <NUM> is replaced with an infrared pixel IR. Referring to <FIG>, one unit pattern includes four quadrant regions, and first through fourth quadrants may be the blue pixel B, the green pixel G, the red pixel R, and the infrared pixel IR, respectively. The unit patterns may be repeatedly and two-dimensionally arranged in a first direction (X direction) and a second direction (Y direction). For example, one green pixel G, one blue pixel B, one red pixel R, and one infrared pixel IR are arranged in a unit pattern of a <NUM>×<NUM> array. In the entire arrangement of pixels, a first row in which a plurality of green pixels G and a plurality of blue pixels B are alternately arranged in the first direction (X direction) and a second row in which a plurality of red pixels R and a plurality of infrared pixels IR are alternately arranged in the first direction (X direction) are repeatedly arranged in the second direction (Y direction).

However, the arrangement of the pixel array <NUM> may have various types, in addition to the arrangement of <FIG>. For example, <FIG> shows an arrangement in which one of the red pixel R and the blue pixel B of the Bayer pattern is replaced with the infrared pixel IR. Also, referring to <FIG>, an arrangement in which the <NUM>×<NUM> unit pattern of the Bayer pattern is replaced with one infrared pixel IR is also possible. In addition, the unit pattern may be in the form of a <NUM>×<NUM> array, and an arrangement in which the green pixel G, the blue pixel B, and the red pixel R are respectively replaced with a magenta pixel M, a cyan pixel C, and a yellow pixel Y is also possible. In addition to the above examples, the pixels in the pixel array <NUM> may be arranged in various ways according to color characteristics of the image sensor <NUM>. Hereinafter, it will be described that the pixel array <NUM> in the image sensor <NUM> has the arrangement of <FIG>, but an operating principle also applies to other types of pixel arrangements.

The pixel array <NUM> of the image sensor <NUM> includes a color separating lens array that condenses light of a color corresponding to a specific pixel. <FIG> and <FIG> are conceptual diagrams showing the structure and operations of a color separating lens array CSLA.

Referring to <FIG>, the color separating lens array CSLA includes a plurality of nanoposts NP that change a phase of incident light Li differently according to an incidence position. The color separating lens array CSLA may be divided in various ways. For example, the color separating lens array CSLA may be divided into a first pixel corresponding region <NUM> corresponding to a first pixel PX1 on which first wavelength light Lλ1 included in the incident light Li is condensed, and a second pixel corresponding region <NUM> corresponding to a second pixel PX2 on which second wavelength light Lλ2 included in the incident light Li is condensed. Each of the first and second pixel corresponding regions <NUM> and <NUM> may include one or more nanoposts NP. The first and second pixel corresponding regions <NUM> and <NUM> may respectively face the first and second pixels PX1 and PX2 in a vertical direction. As another example, the color separating lens array CSLA may be divided into a first wavelength condensing region L1 configured to condense the first wavelength light Lλ1 on the first pixel PX1 and a second wavelength condensing region L2 configured to condense the second wavelength light Lλ2 on the second pixel PX2. The first wavelength condensing region L1 and the second wavelength condensing region L2 may partially overlap each other.

The color separating lens array CSLA may form different phase profiles in the first wavelength light Lλ1 and the second wavelength light Lλ2 included in the incident light Li so that the first wavelength light Lλ1 may be condensed on the first pixel PX1 and the second wavelength light Lλ2 may be condensed on the second pixel PX2.

For example, referring to <FIG>, the color separating lens array CSLA may allow the first wavelength light Lλ1 to have a first phase profile PP1 and the second wavelength light Lλ2 to have a second phase profile PP2 at a location right after passing through the color separating lens array CSLA, at a lower surface location of the color separating lens array CSLA, so that the first wavelength light Lλ1 and the second wavelength light Lλ2 may be condensed on the respective corresponding first and second pixels PX1 and PX2. For example, the first wavelength light Lλ1 passing through the color separating lens array CSLA may have the phase profile PP1 that is the largest at the center of the first pixel corresponding region R1, and reduces in a direction away from the center of the first pixel corresponding region R1, that is, in a direction of the second pixel corresponding region R2. This phase profile may be similar to a phase profile of light converged to a point through a convex lens, for example, a microlens having a convex center, disposed in the first wavelength condensing region L1 and the first wavelength light Lλ1 may be condensed on the first pixel PX1. In addition, the second wavelength light Lλ2 passing through the color separating lens array CSLA may have the phase profile PP2 that is the largest at the center of the second pixel corresponding region R2, and reduces in a direction away from the center of the second pixel corresponding region R2, that is, in a direction of the first pixel corresponding region R1, and may be condensed on the second pixel PX2.

Because the refractive index of a material differs depending on the wavelength of reacting light, as shown in <FIG>, the color separating lens array CSLA may provide different phase profiles with respect to the first wavelength light Lλ1 and the second wavelength light Lλ2. For example, because the same material has a different refractive index according to the wavelength of light reacting to the material and a phase delay experienced by light when passing through the material is also different for each wavelength, a different phase profile may be formed for each wavelength. For example, the refractive index of the first pixel corresponding region R1 with respect to the first wavelength light Lλ1 may be different from the refractive index of the first pixel corresponding region R1 with respect to the second wavelength light Lλ2, and the phase delay experienced by the first wavelength light Lλ1 passing through the first pixel corresponding region R1 and the phase delay experienced by the second wavelength light Lλ2 passing through the first pixel corresponding region R1 may be different from each other. Thus, when the color separating lens array CSLA is designed considering the characteristics of light, different phase profiles may be provided with respect to the first wavelength light Lλ1 and the second wavelength light Lλ2.

The color separating lens array CSLA may include the nanoposts NP arranged in a specific rule so that first wavelength light Lλ1 and the second wavelength light Lλ2 have the first and second phase profiles PP1 and PP2, respectively. Here, the rule may be applied to parameters, such as the shape of the nanoposts NP, sizes (width and height), a distance between the nanoposts NP, and the arrangement form thereof, and these parameters may be determined according to a phase profile to be implemented through the color separating lens array CSLA.

A rule in which the nanoposts NP are arranged in the first pixel corresponding region R1, and a rule in which the nanoposts NP are arranged in the second pixel corresponding region R2 may be different from each other. For example, the shape, size, space, and/or arrangement of the nanoposts NP included in the first pixel corresponding region R1 may be different from the shape, size, space, and/or arrangement of the nanoposts NP included in the second pixel corresponding region R2.

The cross-sectional diameters of the nanoposts NP may have sub-wavelength dimensions. Here, the sub-wavelength refers to a wavelength less than a wavelength band of light to be branched. The nanoposts NP have dimensions less than a shorter wavelength among first and second wavelengths. When the incident light Li is a visible ray, the cross-sectional diameters of the nanoposts NP may have dimensions less than <NUM>, <NUM>, or <NUM>. The heights of the nanoposts NP may be <NUM> to <NUM>, and may be larger than the cross-sectional diameters thereof. The nanoposts NP may be a combination of two or more posts stacked in a height direction (Z direction).

The nanoposts NP may include a material having a higher refractive index than that of a peripheral material. For example, the nanoposts NP may include c-Si, p-Si, a-Si and a Group III-V compound semiconductor (gallium phosphide (GaP), gallium nitride (GaN), gallium arsenide (GaAs), etc.), silicon carbide (SiC), titanium oxide (TiO<NUM>), silicon nitride (SiN), and/or a combination thereof. The nanoposts NP having a difference in a refractive index from the refractive index of the peripheral material may change a phase of light that passes through the nanoposts NP. This is caused by a phase delay due to the shape dimension of the sub-wavelength of the nanoposts NP, and a degree of the phase delay may be determined by detailed shape dimensions, arrangement types, etc. of the nanoposts NP. The peripheral material of the nanoposts NP may include a dielectric material having a lower refractive index than that of the nanoposts NP. For example, the peripheral material may include silicon oxide (SiO<NUM>) or air.

The first wavelength λ1 and the second wavelength λ2 may be in a wavelength band of infrared or visible rays, but are not limited thereto. The first wavelength λ1 and the second wavelength λ2 may operate in a variety of wavelengths according to the arrangement rule of an array of the plurality of nanoposts NP. Although it is described that two wavelengths are branched and condensed, incident light may be branched into three or more directions according to wavelengths and condensed.

In addition, although it is described that the color separating lens array CSLA includes one layer, the color separating lens array CSLA may have a structure in which a plurality of layers are stacked. For example, the CSLA may be designed where a first layer condenses visible light on a specific pixel, and a second layer condenses infrared ray on other pixels.

Hereinafter, an example is described in which the color separating lens array CSLA described above is applied to the pixel array <NUM> of the image sensor <NUM>.

<FIG> and <FIG> are schematic cross-sectional views of the pixel array <NUM> according to an example embodiment, <FIG> is a plan view showing an arrangement of pixels of the pixel array <NUM> of <FIG> and <FIG>, <FIG> is a plan view showing an example of an arrangement of the plurality of nanoposts NP of a color separating lens array <NUM> of <FIG> and <FIG>, and <FIG> is a detailed view of an arrangement of pixel corresponding regions <NUM>, <NUM>, <NUM>, and <NUM> constituting a partial region of <FIG>, e.g., a unit pattern.

Referring to <FIG> and <FIG>, the pixel array <NUM> of the image sensor <NUM> may include a sensor substrate <NUM> including a plurality of pixels <NUM>, <NUM>, <NUM>, and <NUM> sensing light, a transparent spacer layer <NUM> disposed on the sensor substrate <NUM>, and the color separating lens array <NUM> on the spacer layer <NUM>.

The sensor substrate <NUM> may include the green pixel <NUM>, the blue pixel <NUM>, the red pixel <NUM>, and the infrared pixel <NUM> that convert light into electrical signals. As shown in <FIG>, the green pixel <NUM> and the blue pixel <NUM> may be alternately arranged in a first direction (X direction), and in a cross-section in which a Y direction location is different from <FIG>, as shown in <FIG>, the red pixel <NUM> and the infrared pixel <NUM> may be alternately arranged. This region division is for sensing incident light by a unit pattern such as a Bayer pattern. For example, the green pixel <NUM> may sense light having a first wavelength that corresponds to green light, the blue pixel <NUM> may sense light having a second wavelength that corresponds to blue light, the red pixel <NUM> may sense light having a third wavelength that corresponds to red light, and the infrared pixel <NUM> may sense light having a fourth wavelength that corresponds to infrared ray. <FIG> shows an arrangement of the pixels <NUM>, <NUM>, <NUM>, and <NUM> when the pixel array <NUM> of the image sensor <NUM> has an arrangement shown in <FIG>. A separator for separating cells may be further formed in a boundary between cells.

The spacer layer <NUM> may be disposed between the sensor substrate <NUM> and the color separating lens array <NUM> to maintain a gap between the sensor substrate <NUM> and the color separating lens array <NUM> to be constant. The spacer layer <NUM> may include a transparent material with respect to the visible ray, for example, a dielectric material having a lower refractive index than that of the nanoposts NP and a low absorption coefficient in the visible ray band, e.g., SiO<NUM>, siloxane-based spin on glass (SOG), etc. The thickness h of the spacer layer <NUM> may be selected to be within the range of ht - p ≤ h ≤ ht + p. In this regard, when a theoretical thickness ht of the spacer layer <NUM> is expressed by Equation <NUM> below when a refractive index of the spacer layer <NUM> with respect to a wavelength λ<NUM> is n, a pitch of a pixel is p.

Here, the theoretical thickness ht of the spacer layer <NUM> may refer to a focal length at which light having a wavelength of λ<NUM> is condensed onto a top surface of the pixels <NUM>, <NUM>, <NUM>, and <NUM> by the color separating lens array <NUM>. λ<NUM> may be a reference wavelength for determining the thickness h of the spacer layer <NUM>, and the thickness of the spacer layer <NUM> may be designed with respect to <NUM>, which is the central wavelength of green light.

A color filter layer <NUM> and a microlens layer <NUM> may be included between the sensor substrate <NUM> and the spacer layer <NUM>. The color filter layer <NUM> may include filters corresponding to a pixel arrangement of the sensor substrate <NUM>. As shown in <FIG>, a green filter CF1 and a blue filter CF2 are alternately arranged, and as shown in <FIG>, in a next row spaced apart in the Y direction, a red filter CF3 and an infrared filter CF4 are alternately arranged. The color filter layer <NUM> may be designed to cause only light in a specific wavelength band to transmit therethrough. For example, the green filter CF1 may cause only green light to transmit therethrough so that the green light travels to the green pixel <NUM>, and the infrared filter CF4 may absorb and/or reflect visible rays so as not to transmit therethrough, and may cause only infrared ray to transmit therethrough so that the infrared rays travel to the infrared pixel <NUM>. The green, blue, and red filters CF1, CF2, and CF3 may further include a filter that blocks infrared rays besides a filter which transmits only green, blue, and red light among visible light.

The microlens layer <NUM> may include microlenses formed on the green filter CF1, the blue filter CF2, and/or the red filter CF3, and the microlenses may be convex in a Z direction. The microlens layer <NUM> may condense light that passes through the color separating lens array <NUM> and then travels to the green, blue, and red pixels <NUM>, <NUM>, and <NUM> to the center of the pixel. The microlens layer <NUM> may include a light transmissive resin or a material having a refractive index higher than that of a material constituting the spacer layer <NUM> such as TiO<NUM>.

The color separating lens array <NUM> may be supported by the spacer layer <NUM> and may include the nanoposts NPs that change the phase of incident light and dielectrics, such as air or SiO<NUM>, disposed between the nanoposts NPs and having refractive indexes lower than those of the nanoposts NP.

Referring to <FIG>, the color separating lens array <NUM> may be divided into the four pixel corresponding regions <NUM>, <NUM>, <NUM>, and <NUM> respectively corresponding to the pixels <NUM>, <NUM>, <NUM>, and <NUM> of <FIG>. The green pixel corresponding region <NUM> may correspond to the green pixel <NUM> and may be disposed on the green pixel <NUM>, the blue pixel corresponding region <NUM> may correspond to the blue pixel <NUM> and may be disposed on the blue pixel <NUM>, the red pixel corresponding region <NUM> may correspond to the red pixel <NUM> and may be disposed on the red pixel <NUM>, and the infrared pixel corresponding region <NUM> may correspond to the infrared pixel <NUM>, and may be disposed on the infrared pixel <NUM>. For example, the pixel corresponding regions <NUM>, <NUM>, <NUM>, and <NUM> of the color separating lens array <NUM> may be disposed to respectively face the pixels <NUM>, <NUM>, <NUM>, and <NUM> of the sensor substrate <NUM>. The pixel corresponding regions <NUM>, <NUM>, <NUM>, and <NUM> may be two-dimensionally arranged in the first direction (X direction) and the second direction (Y direction) so that a first row in which the green pixel corresponding region <NUM> and the blue pixel corresponding region <NUM> are alternately arranged, and a second row in which the red pixel corresponding region <NUM> and the infrared pixel corresponding region <NUM> are alternately arranged are alternately repeated to each other. The color separating lens array <NUM> may also include a plurality of two-dimensionally arranged unit patterns like a pixel array of the sensor substrate <NUM>, and each unit pattern may include the pixel corresponding regions <NUM>, <NUM>, <NUM>, and <NUM> arranged in a <NUM>×<NUM> form.

The color separating lens array <NUM> may be divided into a green light condensing region condensing green light, a blue light condensing region condensing blue light, and a red light condensing region condensing red light, similarly to that described with reference to <FIG>.

One or more nanoposts NP may be disposed in each of the pixel corresponding regions <NUM>, <NUM>, <NUM>, and <NUM>, and the shape, size, space, and/or arrangement of the nanoposts NP may vary depending on the region. For example, each of the pixel corresponding regions <NUM>, <NUM>, <NUM>, and <NUM> may include one or more nanoposts NP. The size, shape, space, and/or arrangement of the nanoposts NP are determined so that travel directions of green, blue, and red light do not change, and infrared rays are condensed on the infrared pixel <NUM> through the color separating lens array <NUM>. The thickness of the color separating lens array <NUM> in the third direction (Z direction) may be similar to the height of the nanoposts NP, and may be about <NUM> to about <NUM>.

Referring to <FIG>, the pixel corresponding regions <NUM>, <NUM>, <NUM>, and <NUM> may include the nanoposts NP each having a cylindrical shape of a circular cross-section. The nanoposts NP may also be arranged on the center of each of the pixel corresponding regions <NUM>, <NUM>, <NUM>, and <NUM> and a crossing point of pixel boundaries. The nanopost NP having the largest cross-sectional area is disposed on the center of the infrared pixel corresponding region <NUM>, and the nanopost NP disposed farther away from the center of the infrared pixel corresponding region <NUM> may have a less cross-sectional area.

<FIG> is a detailed view of the arrangement of the nanoposts NP in partial regions of <FIG>, that is, the pixel corresponding regions <NUM>, <NUM>, <NUM>, and <NUM> constituting the unit pattern. In <FIG>, the nanoposts NP are indicated as p1 to p4 according to detailed locations thereof. For example, the nanoposts NP may include the nanopost p1 disposed at the center of the infrared pixel corresponding region <NUM>, the nanopost p2 disposed on a crossing point of boundaries dividing the infrared pixel corresponding region <NUM>, the nanopost p3 disposed at the center of the blue and red pixel corresponding regions <NUM> and <NUM>, and the nanopost p4 disposed at the center of the green pixel corresponding region <NUM>. The nanoposts p1 to p4 are arranged in the order of p1 > p2 > p3 > p4 so that the cross-sectional area of the nanopost p1 disposed at the center of the infrared pixel corresponding region <NUM> is the largest, and the nanopost disposed farther away from the center of the infrared pixel corresponding region <NUM> have a less cross-sectional area. However, this is only an example, and the nanoposts NPs of various shapes, sizes, spaces, and/or arrangements may be applied if necessary.

The nanoposts NP have symmetrical circular cross-sectional shapes but are not limited thereto. Some nanoposts having asymmetrical cross-sectional shapes may be included. For example, nanoposts having an asymmetrical cross-sectional shape that has different widths in the first direction (X direction) and the second direction (Y direction) may be employed.

<FIG> shows a phase profile PPG of green light passing through the color separating lens array <NUM> along line I-I' of <FIG>, and <FIG> shows a phase of the green light passing through the color separating lens array <NUM> at the center of the pixel corresponding regions <NUM>, <NUM>, <NUM> and <NUM>.

Referring to <FIG> and <FIG>, the green light passing through the color separating lens array <NUM> may have the green light phase distribution PPG having the constant phase for each location. For example, at a location right after passing through the color separating lens array <NUM>, at a lower surface location of the color separating lens array <NUM> or at an upper surface of the spacer layer <NUM>, when a phase is 2π at the center of the green pixel corresponding region <NUM> of the green light, the phase of the green light at all locations passing through the color separating lens array <NUM> may be 2π. A phase profile that does not change depending on the location is similar to a phase profile of light passing through transparent glass having a uniform thickness, and the green light may pass through the color separating lens array <NUM> while maintaining a direction incident on the color separating lens array <NUM>.

Among the green light passing through the color separating lens array <NUM>, the light directed to the green pixel <NUM> may be condensed on the center of the green pixel <NUM> through a microlens of the microlens layer <NUM> disposed on the green pixel <NUM> and may be photoelectrically converted in the green pixel <NUM> through the green color filter CF1. Among the green light passing through the color separating lens array <NUM>, the light not directed to the green pixel <NUM>, for example, the light directed to the blue pixel <NUM>, may be condensed on the center of the blue pixel <NUM> through a microlens of the microlens layer <NUM> disposed on the blue pixel <NUM>, but the light may be absorbed and/or reflected by the blue color filter CF2 and not be sensed by the blue pixel <NUM>.

<FIG> shows a phase profile PPIR of infrared ray passing through the color separating lens array <NUM> along line II-II' of <FIG>, and <FIG> shows a phase of the infrared ray passing through the color separating lens array <NUM> at the center of the pixel corresponding regions <NUM>, <NUM>, <NUM> and <NUM>.

Referring to <FIG> and <FIG>, the infrared ray passing through the color separating lens array <NUM> may have the infrared ray phase profile PPIR that is the largest at the center of the infrared pixel corresponding region134 and reduces in a direction away from the center of the infrared pixel corresponding region <NUM>. For example, at a location right after passing through the color separating lens array <NUM>, at a lower surface location of the color separating lens array <NUM> or at an upper surface of the spacer layer <NUM>, the phase of the infrared ray may be the largest at the center of the infrared pixel corresponding region <NUM>, may gradually reduce in the form of a concentric circle away from the center of the infrared pixel corresponding region <NUM>, may be the smallest at the center of the blue and red pixel corresponding regions <NUM> and <NUM> in the X and Y directions, and may be the smallest at the center of the green pixel corresponding region <NUM> in the diagonal direction. When the phase of the infrared ray at the center of the infrared pixel corresponding region <NUM> is 2π, the phase of the infrared ray may be <NUM>. 9π to <NUM>. 1π at the center of the blue and red pixel corresponding regions <NUM> and <NUM>, and may be a value less than π, about <NUM>. 2π to <NUM>. 9π, at the center of the green pixel corresponding region <NUM>. The infrared ray phase profile PPIR may not mean that a phase delay amount of the light passing through the center of the infrared pixel corresponding region <NUM> is the largest. When the phase of the light passing through the infrared pixel corresponding region <NUM> is determined as 2π, when the phase delay of light passing through another location is larger and has a phase value larger than 2π, the phase value may be a value remaining by removing by 2nπ, that is, a profile of a wrapped phase. For example, when the phase of light passing through the infrared pixel corresponding region <NUM> is 2π, and the phase of light passing through the center of the red pixel corresponding region <NUM> is 3π, the phase in the red pixel corresponding region <NUM> may be π remaining by removing 2π (when n=<NUM>) from 3π.

<FIG> shows a traveling direction of infrared ray incident on an infrared condensing region IRL, and <FIG> shows an array of the infrared condensing region IRL.

The infrared ray is condensed on the infrared pixel <NUM> by the color separating lens array <NUM> as shown in <FIG>, and the infrared ray from the pixel corresponding regions <NUM>, <NUM>, <NUM>, and <NUM> is incident on the infrared pixel <NUM>. In the phase profile PPIR of the infrared ray described above with reference to <FIG> and <FIG>, the infrared ray passing through the infrared condensing region IRL by connecting the centers of four green corresponding regions <NUM> adjacent to the infrared pixel corresponding region <NUM> with vertexes facing each other is condensed on the infrared pixel <NUM>. Accordingly, as shown in <FIG>, the color separating lens array <NUM> may operate as the array of the infrared condensing region IRL in which the infrared ray is condensed on the infrared pixel <NUM>. Because an area of the infrared condensing region IRL is larger than that of the corresponding infrared pixel <NUM>, not only the infrared ray traveling to the infrared pixel <NUM> but also the infrared ray traveling to directions of the green, blue, and red pixels <NUM>, <NUM>, and <NUM> may also be condensed on the infrared pixel <NUM>. The area of the infrared condensing region IRL may be <NUM> to <NUM> times larger than the area of the infrared pixel <NUM>. As described above, because the infrared ray may be condensed by the color separating lens array <NUM>, a separate microlens may not be disposed on the infrared filter CF4.

Referring back to <FIG>, the infrared ray passing through the color separating lens array <NUM> may be photoelectrically converted in the infrared pixel <NUM> through the infrared filter CF4 formed on the infrared pixel <NUM>. The infrared filter CF4 may be a filter for blocking visible light, and may block green, blue, and red light from being incident on the infrared pixel <NUM>.

Phase profiles of the red light and blue light passing through the color separating lens array <NUM> is similar to the phase profile of the green light described above with reference to <FIG>. For example, there is no phase difference between the red light and blue light passing through the color separating lens array <NUM>.

Among the blue light passing through the color separating lens array <NUM>, the light directed to the blue pixel <NUM> may be condensed on the center of the blue pixel <NUM> through a microlens of the microlens layer <NUM> formed on the blue pixel <NUM>, and may be photoelectrically converted in the blue pixel <NUM> through the blue color filter CF2. Among the blue light passing through the color separating lens array <NUM>, the light directed to the green, red, and infrared pixels <NUM>, <NUM> and <NUM> may be absorbed and/or reflected by the green, red, and infrared filters CF1, CF3 and CF4 and not be sensed by the green, red, and infrared pixels <NUM>, <NUM>, and <NUM>.

Similarly, the red light passing through the color separating lens array <NUM> may be sensed by the red pixel <NUM> and not sensed by the green, blue, and infrared pixels <NUM>, <NUM>, and <NUM>.

<FIG> and <FIG> are cross-sectional views of a pixel array <NUM>' according to another example embodiment, <FIG> is a plan view showing an example of an arrangement of the plurality of nanoposts NP of a color separating lens array <NUM>' of <FIG> and <FIG>, and <FIG> is a detailed view of an arrangement of nanoposts NP' of a partial region of <FIG>.

Referring to <FIG> and <FIG>, the pixel array <NUM>' of the image sensor <NUM> may include the sensor substrate <NUM> including the plurality of pixels <NUM>, <NUM>, <NUM>, and <NUM> sensing light, the transparent spacer layer <NUM> disposed on the sensor substrate <NUM>, and the color separating lens array <NUM>' on the spacer layer <NUM>. The pixel array <NUM>' of <FIG> and <FIG> is different from the pixel array <NUM> of <FIG> and <FIG> in that the pixel array <NUM>' condenses green, blue, and red light on the green, blue, and red pixels <NUM>, <NUM>, and <NUM>, respectively, and may not include a microlens layer and a color filter layer. In the description of the example embodiment of <FIG> and <FIG>, redundant descriptions with the description of the pixel array <NUM> of <FIG> and <FIG> will be omitted.

The sensor substrate <NUM> may include the pixels <NUM>, <NUM>, <NUM>, and <NUM> that convert light into electrical signals, and the pixels <NUM>, <NUM>, <NUM> and <NUM> may sense light of first to fourth wavelengths, respectively. Hereinafter, light of the first wavelength is green light, light of the second wavelength is blue light, light of the third wavelength is red light, and light of the fourth wavelength is infrared ray. The arrangement of the pixels of <FIG> and <FIG> is the same as that described with reference to <FIG>.

A color filter and a microlens may be omitted between the sensor substrate <NUM> and the spacer layer <NUM>. For example, because the color separating lens array <NUM>' of <FIG> and <FIG> separates and condenses green light, blue light, red light and infrared ray into the respective pixels, the color separating lens array <NUM>' may operate without a color filter and a microlens, but a color filter may be applied if necessary in order to increase color purity and color reproducibility. When the color filter is applied, for example, a visible light cut-filter may be applied to the upper portion of the infrared pixel <NUM>, and an infrared cut-filter may be applied to the upper portions of the green, blue, and red pixels <NUM>, <NUM>, and <NUM>.

The color separating lens array <NUM>' may include the nanoposts NP' arranged to change phases of green light, blue light, red light, and infrared ray and condense the green light on the green pixel <NUM>, the blue light on the blue pixel <NUM>, the red light on the red pixel <NUM>, and the infrared ray on the infrared pixel <NUM>.

Referring to <FIG>, pixel corresponding regions <NUM>', <NUM>', <NUM>', and <NUM>' may include the nanoposts NP' each having a cylindrical shape of a circular cross-section. The nanoposts NP' may be also arranged inside of each of the pixel corresponding regions <NUM>', <NUM>', <NUM>', and <NUM>' and a crossing point of pixel boundaries. Compared to the color separating lens array <NUM> of <FIG>, the color separating lens array <NUM>' of <FIG> may further include nanoposts for condensing visible light, that is, green light, blue light, and red light.

<FIG> is a detailed view of the arrangement of the nanoposts NP' in partial regions of <FIG>, that is, the pixel corresponding regions <NUM>', <NUM>', <NUM>', and <NUM>' constituting the unit pattern. Compared to the color separating lens array <NUM> of <FIG>, the color separating lens array <NUM>' of <FIG> may further include nanoposts p'<NUM>, p'<NUM>, and p'<NUM> disposed inside the green, blue and red pixel corresponding regions <NUM>', <NUM>', and <NUM>'. For example, the color separating lens array <NUM>' may include four nanoposts p'<NUM> disposed between the center of the green pixel corresponding region <NUM>' and each vertex of the green pixel corresponding region <NUM>', four nanoposts p'<NUM> disposed between the center of the blue pixel corresponding region <NUM>' and each vertex of the blue pixel corresponding region <NUM>', and four nanoposts p'<NUM> disposed between the center of the red pixel corresponding region <NUM>' and each vertex of the red pixel corresponding region <NUM>'. The cross-sectional area of the nanoposts p'<NUM> added to the green pixel corresponding region <NUM>' may be larger than the cross-sectional area of the nanoposts p'<NUM> and p'<NUM> added to the blue and red pixel corresponding regions <NUM>' and <NUM>', and the cross-sectional area of the nanoposts p'<NUM> added to the blue pixel corresponding region <NUM>' may be larger than the cross-sectional area of the nanoposts p'<NUM> added to the red pixel corresponding region <NUM>'.

In addition, although the color separating lens array <NUM>' of <FIG> shows an interleaved structure in which the additional nanoposts p'<NUM>, p'<NUM>, and p'<NUM> and the nanoposts p1, p2, p3, and p4 included in the color separating lens array <NUM> of <FIG> are formed together on the same layer, the color separating lens array <NUM>' may be implemented as a structure in which a color separating lens array for condensing infrared ray and a color separating lens array for condensing visible ray are formed as separate layers and a plurality of color separating lens array layers are stacked vertically.

<FIG> shows phase profiles PPG' and PPB' of green light and blue light passing through the color separating lens array <NUM>' along line III-III' of <FIG>, <FIG> shows a phase of the green light passing through the color separating lens array <NUM>' at the center of the pixel corresponding regions <NUM>', <NUM>', <NUM>', and <NUM>', and <FIG> shows a phase of the blue light passing through the color separating lens array <NUM>' at the center of the pixel corresponding regions <NUM>', <NUM>', <NUM>', and <NUM>'.

Referring to <FIG> and <FIG>, the green light passing through the color separating lens array <NUM>' may have the phase profile PPG' that is the largest at the center of the green pixel corresponding region <NUM>' and reduce in a direction away from the center of the green pixel corresponding region <NUM>'. For example, at a location right after passing through the color separating lens array <NUM>', at a lower surface location of the color separating lens array <NUM>' or at an upper surface of the spacer layer <NUM>, the phase of the green light may be the largest at the center of the green pixel corresponding region <NUM>', may gradually reduce in the form of a concentric circle away from the center of the green pixel corresponding region <NUM>', may be the smallest at the center of the blue and red pixel corresponding regions <NUM>' and <NUM>' in the X and Y directions, and may be the smallest at the center of the infrared pixel corresponding region <NUM>' in the diagonal direction. When the phase of the green light at the center of the green pixel corresponding region <NUM>' is 2π, the phase of the green light may be <NUM>. 9π to <NUM>. 1π at the center of the blue and red pixel corresponding regions <NUM>' and <NUM>', and may be a value less than π, about <NUM>. 2π to <NUM>. 9π, at the center of the infrared pixel corresponding region <NUM>'.

Referring to <FIG> and <FIG>, the blue light passing through the color separating lens array <NUM>' may have the phase profile PPB' that is the largest at the center of the blue pixel corresponding region <NUM>' and reduce in a direction away from the center of the blue pixel corresponding region <NUM>'. For example, at a location right after passing through the color separating lens array <NUM>', the phase of the blue light may be the largest at the center of the blue pixel corresponding region <NUM>', may gradually reduce in the form of a concentric circle away from the center of the blue pixel corresponding region <NUM>', may be the smallest at the center of the green and infrared pixel corresponding regions <NUM>' and <NUM>' in the X and Y directions, and may be the smallest at the center of the red pixel corresponding region <NUM>' in the diagonal direction. When the phase of the blue light at the center of the blue pixel corresponding region <NUM>' is 2π, the phase of the blue light may be <NUM>. 9π to <NUM>. 1π at the center of the green and infrared pixel corresponding regions <NUM>' and <NUM>', and may be a value less than π, about <NUM>. 2π to <NUM>. 9π, at the center of the red pixel corresponding region <NUM>'.

<FIG> shows a traveling direction of the green light incident on the green pixel corresponding region <NUM>' of the color separating lens array <NUM>' corresponding to the green pixel <NUM> and the periphery thereof, and <FIG> shows a green light condensing region GL'.

The green light incident on the green pixel corresponding region <NUM>' is condensed on the green pixel <NUM> by the color separating lens array <NUM>', as shown in <FIG>, and the green light from the pixel corresponding regions <NUM>', <NUM>', <NUM>', and <NUM>' is incident on the green pixel <NUM>. In the phase profile PPG' of the green light described above with reference to <FIG> and <FIG>, the green light incident on the green light condensing region GL' by connecting the centers of four infrared pixel corresponding regions <NUM>' adjacent to the green pixel corresponding region <NUM>' with vertexes facing each other is condensed on the green pixel <NUM>. Accordingly, as shown in <FIG>, the color separating lens array <NUM>' may operate as an array of the green light condensing region GL'. The area of each of the green light condensing regions GL' may be <NUM> to <NUM> times larger than the area of the green pixel <NUM>.

<FIG> shows a traveling direction of the blue light incident on the blue pixel corresponding region <NUM>' of the color separating lens array <NUM>' corresponding to the blue pixel <NUM> and the periphery thereof, and <FIG> shows a blue light condensing region BL'.

The blue light is condensed on the blue pixel <NUM> by the color separating lens array <NUM>', as shown in <FIG>, and the blue light from the pixel corresponding regions <NUM>', <NUM>', <NUM>', and <NUM>' is incident on the blue pixel <NUM>. In the phase profile PPB' of the blue light described above with reference to <FIG> and <FIG>, the blue light incident on the blue light condensing region BL' by connecting the centers of four red pixel corresponding regions <NUM>' adjacent to the blue pixel corresponding region <NUM>' with vertexes facing each other is condensed on the blue pixel <NUM>. Accordingly, as shown in <FIG>, the color separating lens array <NUM>' may operate as an array of the blue light condensing region BL'. The area of each of the blue light condensing regions BL' may be <NUM> to <NUM> times larger than the area of the blue pixel <NUM>.

<FIG> shows phase profiles PPR' and PPIR' of red light and infrared ray passing through the color separating lens array <NUM>' along line IV-IV' of <FIG>, <FIG> shows a phase of the red light passing through the color separating lens array <NUM>' at the center of the pixel corresponding regions <NUM>', <NUM>', <NUM>', and <NUM>', and <FIG> shows a phase of the infrared ray passing through the color separating lens array <NUM>' at the center of the pixel corresponding regions <NUM>', <NUM>', <NUM>', and <NUM>'.

Referring to <FIG> and <FIG>, the red light passing through the color separating lens array <NUM>' may have the phase profile PPR' that is the largest at the center of the red pixel corresponding region <NUM>' and reduce in a direction away from the center of the red pixel corresponding region <NUM>'. For example, at a location right after passing through the color separating lens array <NUM>', at a lower surface location of the color separating lens array <NUM>' or at an upper surface of the spacer layer <NUM>, the phase of the red light may be the largest at the center of the red pixel corresponding region <NUM>', may gradually reduce in the form of a concentric circle away from the center of the red pixel corresponding region <NUM>', may be the smallest at the center of the green and infrared pixel corresponding regions <NUM>' and <NUM>' in the X and Y directions, and may be the smallest at the center of the blue pixel corresponding region <NUM>' in the diagonal direction. When the phase of the red light at the center of the red pixel corresponding region <NUM>' is 2π, the phase of the red light may be <NUM>. 9π to <NUM>. 1π at the center of the green and infrared pixel corresponding regions <NUM>' and <NUM>', and may be a value less than π, about <NUM>. 2π to <NUM>. 9π, at the center of the blue pixel corresponding region <NUM>'.

Referring to <FIG> and <FIG>, the infrared ray passing through the color separating lens array <NUM>' may have the phase profile PPIR' that is the largest at the center of the infrared pixel corresponding region <NUM>' and reduces in a direction away from the center of the infrared pixel corresponding region <NUM>', and the phase profile PPIR' of the infrared ray is the same as described with reference to <FIG> and <FIG> above.

<FIG> shows a traveling direction of the red light incident on the red pixel corresponding region <NUM>' of the color separating lens array <NUM>' corresponding to the red pixel <NUM> and the periphery thereof, and <FIG> shows a red light condensing region RL'.

The red light incident on the red pixel corresponding region <NUM>' is condensed on the red pixel <NUM> by the color separating lens array <NUM>', as shown in <FIG>, and the red light from the pixel corresponding regions <NUM>', <NUM>', <NUM>', and <NUM>' is incident on the red pixel <NUM>. In the phase profile PPR' of the red light described above with reference to <FIG> and <FIG>, the red light incident on the red light condensing region RL' by connecting the centers of four blue pixel corresponding regions <NUM>' adjacent to the red pixel corresponding region <NUM>' with vertexes facing each other is condensed on the red pixel <NUM>. Accordingly, as shown in <FIG>, the color separating lens array <NUM>' may operate as an array of the red light condensing region RL'. The area of each of the red light condensing regions RL' may be <NUM> to <NUM> times larger than the area of the red pixel <NUM>.

The phase profile PPIR' and condensing of the infrared ray by the color separating lens array <NUM>' are similar to those given with reference to <FIG> and <FIG> above, and thus, redundant descriptions thereof will be omitted.

<FIG> and <FIG> are schematic cross-sectional views of a pixel array <NUM>" according to another example embodiment, <FIG> is a plan view showing an example of an arrangement of nanoposts NP" of a color separating lens array <NUM>" of <FIG> and <FIG>, and <FIG> is a detailed and enlarged plan view of a part of <FIG>.

Referring to <FIG> and <FIG>, the pixel array <NUM>" of the image sensor <NUM> may include the sensor substrate <NUM> including the plurality of pixels <NUM>, <NUM>, <NUM>, and <NUM> sensing light, the transparent spacer layer <NUM> disposed on the sensor substrate <NUM>, and the color separating lens array <NUM>" on the spacer layer <NUM>. The pixel array <NUM>" of <FIG> and <FIG> is different from the pixel array <NUM>' of <FIG> and <FIG> in that the pixel array <NUM>" condenses combined light of green light and infrared ray on the green and infrared pixels <NUM> and <NUM> and the pixel array <NUM>' respectively condenses green light and infrared ray on different pixels. In the description of the example embodiment of <FIG> and <FIG>, redundant descriptions with the description of the pixel array <NUM> of <FIG> and <FIG> and the pixel array <NUM>' of <FIG> and <FIG> will be omitted.

The sensor substrate <NUM> may include the pixels <NUM>, <NUM>, <NUM>, and <NUM> that convert light into electrical signals, and the pixels <NUM>, <NUM>, <NUM> and <NUM> may sense light of green light, blue light, red light, and infrared ray, respectively. The arrangement of the pixels of <FIG> and <FIG> is the same as that described with reference to <FIG>.

A color filter layer <NUM>" may be disposed between the sensor substrate <NUM> and the spacer layer <NUM>. The color filter layer <NUM>" may include a green color filter CF1" disposed on the green pixel <NUM> and an infrared filter CF4" disposed on the infrared pixel <NUM>. A color filter may be omitted on the blue and red pixels <NUM> and <NUM>. For example, because the color separating lens array <NUM>" condenses the green light and the infrared ray on the green and infrared pixels <NUM> and <NUM> at the same time, in order to sense only the green light from the green pixel <NUM>, the green color filter CF1" that blocks the infrared ray may be disposed on the green pixel <NUM>, and the infrared filter CF4" that blocks the green light may be disposed on the infrared pixel <NUM>. The green color filter CF1" may be a filter which transmits only the green light or a filter which blocks only the infrared ray. The infrared filter CF4" may be a visible light blocking filter or a green light blocking filter. Because blue light is condensed on the blue pixel <NUM> and red light is condensed on the red pixel <NUM> by the color separating lens array <NUM>", a color filter may not be disposed on the blue and red pixels <NUM> and <NUM>.

The color separating lens array <NUM>" may include the nanoposts NP" arranged to change phases of the green light, blue light, red light, and infrared ray and condense combined light of the green light and the infrared ray on the green pixel <NUM> and the infrared pixel <NUM>, the blue light on the blue pixel <NUM>, and the red light on the red pixel <NUM>.

Referring to <FIG>, the pixel corresponding regions <NUM>", <NUM>", <NUM>", and <NUM>" of <FIG> and <FIG> may include the nanoposts NP" each having a cylindrical shape of a circular cross-section. The nanoposts NP" having different cross-sectional areas from one another may be arranged on the center of each of the first to fourth regions <NUM>", <NUM>", <NUM>", and <NUM>". The nanoposts NP" may be also arranged on the center of a boundary between pixels and a crossing point of the pixel boundaries. The cross-sectional area of the nanoposts NP" arranged at the boundary between pixels may be less than those of the nanoposts NP" arranged at the center of the pixel.

<FIG> is a detailed view of the arrangement of the nanoposts NP" in partial regions of <FIG>, that is, the pixel corresponding regions <NUM>", <NUM>", <NUM>", and <NUM>" constituting the unit pattern. In <FIG>, the nanoposts NP" are indicated as p"<NUM> to p"<NUM> according to detailed locations thereof. Referring to <FIG>, from among the nanoposts NP", a nanopost p"<NUM> on the center of the green pixel corresponding region <NUM>" and a nanopost p"<NUM> on the center of the infrared pixel corresponding region <NUM>" have larger cross-sectional areas than those of a nanopost p"<NUM> on the center of the blue pixel corresponding region <NUM>" or a nanopost p"<NUM> on the center of the red pixel corresponding region <NUM>", and the nanopost p"<NUM> on the center of the blue pixel corresponding region <NUM>" has a larger cross-sectional area than that of the nanopost p"<NUM> on the center of the red pixel corresponding region <NUM>".

The nanoposts NP" included in the green and infrared pixel corresponding regions <NUM>" and <NUM>" may have different distribution rules in the first direction (X direction) and the second direction (Y direction). For example, the nanoposts NP" included in the green and infrared pixel corresponding regions <NUM>" and <NUM>" may have different size arrangement in the first direction (X direction) and the second direction (Y direction). As shown in <FIG>, from among the nanoposts NP", a cross-sectional area of a nanopost p"<NUM> located at a boundary between the green pixel corresponding region <NUM>" and the blue pixel corresponding region <NUM>" that is adjacent to the green pixel corresponding region <NUM>" in the first direction (X direction) is different from that of a nanopost p"<NUM> located at a boundary between the green pixel corresponding region <NUM>" and the red pixel corresponding region <NUM>" that is adjacent to the green pixel corresponding region <NUM>" in the second direction (Y direction). Similarly, a cross-sectional area of a nanopost p"<NUM> at the boundary between the infrared pixel corresponding region <NUM>" and the red pixel corresponding region <NUM>" that is adjacent to the infrared pixel corresponding region <NUM>" in the first direction (X direction) is different from that of a nanopost p"<NUM> located at the boundary between the infrared pixel corresponding region <NUM>" and the blue pixel corresponding region <NUM>" that is adjacent to the infrared pixel corresponding region <NUM>" in the second direction (Y direction).

The nanoposts NP" arranged in the blue and red pixel corresponding regions <NUM>" and <NUM>" may have symmetrical distribution rules in the first and second directions (X direction and Y direction). As shown in <FIG>, from among the nanoposts NP", the cross-sectional area of the nanoposts p"<NUM> at a boundary between adjacent pixels that are adjacent to the blue pixel corresponding region <NUM>" in the first direction (X direction) and the cross-sectional areas of the nanoposts p"<NUM> at a boundary between pixels adjacent to the blue pixel corresponding region <NUM>" in the second direction (Y direction) are the same as each other, and in the red pixel corresponding region <NUM>", the cross-sectional areas of the nanoposts p"<NUM> at a boundary between adjacent pixels in the first direction (X direction) and the cross-sectional areas of the nanoposts p"<NUM> at a boundary between the adjacent pixels in the second direction (Y direction) are the same as each other.

In addition, the nanoposts p"<NUM> at four corners in each of the pixel corresponding regions <NUM>", <NUM>", <NUM>", and <NUM>", that is, points where the four regions cross one another, have the same cross-sectional areas from one another.

In the blue and red pixel corresponding regions <NUM>" and <NUM>", the nanoposts NP" may be arranged in the form of <NUM>-fold symmetry, and in the green and infrared pixel corresponding regions <NUM>" and <NUM>", the nanoposts NP" may be arranged in the form of <NUM>-fold symmetry. In particular, the green and infrared pixel corresponding regions <NUM>" and <NUM>" are rotated by <NUM>° angle with respect to each other.

The nanoposts NP" have symmetrical circular cross-sectional shapes but are not limited thereto. Some nanoposts having asymmetrical cross-sectional shapes may be included. For example, the green and infrared pixel corresponding regions <NUM>" and <NUM>" may employ the nanoposts having an asymmetrical cross-sectional shape that has different widths in the first direction (X direction) and the second direction (Y direction), and the blue and red pixel corresponding regions <NUM>" and <NUM>" may employ the nanoposts having a symmetrical cross-sectional shape having the identical widths in the first direction (X direction) and the second direction (Y direction).

<FIG> shows phase profiles PPG-IR1" and PPB" of combined light of green light and infrared light, and blue light passing through the color separating lens array <NUM>" along line V-V' of <FIG>, <FIG> shows phase profiles PPR" and PPR-IR2" of red light and combined light of the green light and infrared ray passing through the color separating lens array <NUM>" along line VI-VI' of <FIG>, and <FIG> shows a phase of the combined light of green light and infrared light passing through the color separating lens array <NUM>" at the center of the pixel corresponding regions <NUM>", <NUM>", <NUM>", and <NUM>".

Referring to <FIG>, the green light and the infrared ray passing through the color separating lens array <NUM>" may have a phase profile PPG-IR1" that is the largest at the center of the green pixel corresponding region <NUM>" and the center of the infrared pixel corresponding region <NUM>" and reduces in a direction away from the center of the green pixel corresponding region <NUM>" and the center of the infrared pixel corresponding region <NUM>". For example, at a location right after passing through the color separating lens array <NUM>", at a lower surface location of the color separating lens array <NUM>" or at an upper surface of the spacer layer <NUM>, the phase of the green light and the infrared ray may be the largest at the center of the green and infrared pixel corresponding regions <NUM>" and <NUM>", may gradually reduce in the form of a concentric circle away from the center of the green and infrared pixel corresponding regions <NUM>" and <NUM>", may be the smallest at the center of the blue and red pixel corresponding regions <NUM>" and <NUM>" in the X and Y directions, and may be the smallest at a contact point of the green and infrared pixel corresponding regions <NUM>" and <NUM>" in the diagonal direction. When the phases of the green light and the infrared ray at the center of the green and infrared pixel corresponding regions <NUM>" and <NUM>" are 2π, the phases of the green light and the infrared ray may be <NUM>. 9π to <NUM>. 1π at the center of the blue and red pixel corresponding regions <NUM>" and <NUM>", and may be about <NUM>π to <NUM>π, at the contact point of the green and infrared pixel corresponding regions <NUM>" and <NUM>".

<FIG> and <FIG> show traveling directions of the green light and the infrared ray incident on the green and infrared pixel corresponding regions <NUM>" and <NUM>" of the color separating lens array <NUM>" and the peripheries thereof, and <FIG> shows green light and infrared ray condensing regions G-IRL1" and G-IRL2".

The green light and the infrared ray incident on the peripheries of the green and infrared pixel corresponding regions <NUM>" and <NUM>" may be condensed on the green and infrared pixels <NUM> and <NUM> by the color separating lens array <NUM>" as shown in <FIG> and <FIG>, and the green light and the infrared ray from the green, blue, and red pixel corresponding regions <NUM>", <NUM>", and <NUM>" may be incident on the green pixel <NUM> and the infrared pixel <NUM>. In the phase profiles PPG-IR1" of the green light and the infrared ray described above with reference to <FIG>, the green light and the infrared ray incident on a first green light and infrared condensing region G-IRL1" of <FIG> and a second green light and infrared condensing region G-IRL2" of <FIG> by connecting the centers of two blue pixel corresponding regions <NUM>" and two red pixel corresponding regions <NUM>" adjacent to the green pixel corresponding region <NUM>" or the infrared pixel corresponding region <NUM>" with one side facing each other are condensed on the green and infrared pixels <NUM> and <NUM>. Areas of the first and second green light and infrared condensing region G-IRL1" and G-IRL2" may be <NUM> to <NUM> times larger than those of the corresponding green and infrared pixels <NUM> and <NUM>.

The phase profile and condensing of the blue light and the red light passing through the color separating lens array <NUM>" referring to <FIG> and <FIG> are similar to those of the pixel array <NUM>' described with reference to <FIG> and <FIG> above, and thus, redundant descriptions thereof will be omitted. As described above, areas of a blue light condensing region and a red light condensing region may be <NUM> times to <NUM> times larger than areas of the corresponding blue pixel <NUM> and red pixel <NUM>. Therefore, the areas of the blue light condensing region and the red light condensing region may be larger than the areas of the first and second green light and infrared condensing region G-IRL1" and G-IRL2".

The color separating lens arrays <NUM>, <NUM>', and <NUM>" satisfying the phase profiles and performance described above may be automatically designed through various types of computer simulations. For example, the structures of the green, blue, red, and infrared pixel corresponding regions may be optimized through a nature-inspired algorithm such as a genetic algorithm, a particle swarm optimization algorithm, an ant colony optimization algorithm, etc., or a reverse design based on an adjoint optimization algorithm.

The structures of the green, blue, red, and infrared pixel corresponding regions may be optimized while evaluating performances of a plurality of candidate color separating lens arrays based on evaluation factors such as color separation spectrum, optical efficiency, signal-to-noise ratio, etc. when designing a color separating lens array. For example, the structures of the green, blue, red, and infrared pixel corresponding regions may be optimized in a manner that a target numerical value of each evaluation factor is determined in advance and the sum of the differences from the target numerical values of a plurality of evaluation factors is minimized. Alternatively, the performance may be indexed for each evaluation factor, and the structures of the green, blue, red, and infrared pixel corresponding regions may be optimized so that a value representing the performance may be maximized.

The color separating lens arrays <NUM>, <NUM>', and <NUM>" shown in <FIG>, <FIG>, and <FIG> are examples. In addition, the color separating lens arrays <NUM>, <NUM>', and <NUM>" of various types may be obtained through the above optimization design, according to the sizes and thicknesses of the color separating lens arrays <NUM>, <NUM>', and <NUM>", color characteristics and pitches between pixels in the image sensor, to which the color separating lens arrays <NUM>, <NUM>', and <NUM>" are to be applied, distances between the color separating lens arrays <NUM>, <NUM>', and <NUM>" and the image sensor, an incidence angle of the incident light, etc. For example, <FIG> is a plan view showing a shape of a unit pattern in a color separating lens array 130a according to another embodiment, which may be applied to an image sensor of Bayer pattern type, and <FIG> is a plan view showing a shape of a unit pattern in a color separating lens array 130b according to another embodiment.

Each of pixel corresponding regions 131a, 132a, 133a, and 134a shown in <FIG> is optimized in a digitized binary form in a <NUM>×<NUM> rectangular arrangement, and the unit pattern shown in <FIG> has a shape of <NUM>×<NUM> rectangular arrangement. Each of pixel corresponding regions 131b, 132b, 133b, 134b shown in <FIG> may be optimized in the form of a continuous curve that is not digitized.

In the image sensor <NUM> including the pixel arrays <NUM>, <NUM>', and <NUM>" described above, because light loss caused by a color filter, for example, an organic color filter rarely occurs, a sufficient light intensity may be provided to pixels even when sizes of the pixels are reduced. Therefore, an ultra-high resolution, ultra-small, and highly sensitive image sensor having hundreds of millions of pixels or more may be manufactured. Such an ultra-high resolution, ultra-small, and highly sensitive image sensor may be employed in various high-performance optical devices or high-performance electronic devices. For example, the electronic devices may include, for example, smart phones, personal digital assistants (PDAs), laptop computers, personal computers (PCs), a variety of portable devices, electronic devices, surveillance cameras, medical camera, automobiles, Internet of Things (IoT), other mobile or non-mobile computing devices and are not limited thereto.

In addition to the image sensor <NUM>, the electronic device may further include a processor controlling the image sensor, for example, an application processor (AP), to drive an operating system or an application program through the processor and control a plurality of hardware or software components, and perform various data processing and operations. The processor may further include a graphic processing unit (GPU) and/or an image signal processor. When the processor includes the image signal processor, an image (or video) obtained by the image sensor may be stored and/or output using the processor.

<FIG> is a block diagram of an example showing an electronic device <NUM> including the image sensor <NUM> according to an embodiment. Referring to <FIG>, in a network environment <NUM>, the electronic device <NUM> may communicate with another electronic device <NUM> through a first network <NUM> (a short-range wireless communication network, etc.) or communicate with another electronic device <NUM> and/or a server <NUM> through a second network <NUM> (a remote wireless communication network, etc.) The electronic device <NUM> may communicate with the electronic device <NUM> through the server <NUM>. The electronic device <NUM> may include a processor <NUM>, a memory <NUM>, an input device <NUM>, a sound output device <NUM>, a display apparatus <NUM>, an audio module <NUM>, a sensor module <NUM>, an interface <NUM>, a haptic module <NUM>, a camera module <NUM>, a power management module <NUM>, a battery <NUM>, a communication module <NUM>, a subscriber identification module <NUM>, and/or an antenna module <NUM>. The electronic device <NUM> may omit some (the display apparatus <NUM>, etc.) of the components or may further include other components. One or more of the components may be implemented as an integrated circuit. For example, the sensor module <NUM> (a fingerprint sensor, an iris sensor, an illumination sensor, etc.) may be embedded in the display apparatus <NUM> (a display, etc.).

The processor <NUM> may be configured to execute software (a program <NUM>, etc.) to control one or a plurality of components (hardware or software components) of the electronic device <NUM>, the components being connected to the processor <NUM>, and to perform various data processing or calculations. As part of the data processing or calculations, the processor <NUM> may be configured to load a command and/or data received from other components (the sensor module <NUM>, the communication module <NUM>, etc.) into the volatile memory <NUM>, process the command and/or the data stored in a volatile memory <NUM>, and store resultant data in a nonvolatile memory <NUM>. The processor <NUM> may include a main processor <NUM> (a central processing unit (CPU), an application processor (AP), etc.) and an auxiliary processor <NUM> (a graphics processing unit (GPU), an image signal processor, a sensor hub processor, a communication processor, etc.) which may independently operate or operate with the main processor <NUM>. The auxiliary processor <NUM> may use less power than the main processor <NUM> and may perform specialized functions.

When the main processor <NUM> is in an inactive state (a sleep state), the auxiliary processor <NUM> may take charge of an operation of controlling functions and/or states related to one or more components (the display apparatus <NUM>, the sensor module <NUM>, the communication module <NUM>, etc.) from among the components of the electronic device <NUM>, or when the main processor <NUM> is in an active state (an application execution state), the auxiliary processor <NUM> may perform the same operation along with the main processor <NUM>. The auxiliary processor <NUM> (the image signal processor, the communication processor, etc.) may be realized as part of other functionally-related components (the camera module <NUM>, the communication module <NUM>, etc.).

The memory <NUM> may store various data required by the components (the processor <NUM>, the sensor module <NUM>, etc.) of the electronic device <NUM>. The data may include, for example, software (the program <NUM>, etc.), input data and/or output data of a command related to the software. The memory <NUM> may include the volatile memory <NUM> and/or the nonvolatile memory <NUM>. The nonvolatile memory <NUM> may include an internal memory <NUM> fixedly mounted in the electronic device <NUM> and a removable external memory <NUM>.

The program <NUM> may be stored in the memory <NUM> as software, and may include an operating system <NUM>, middleware <NUM>, and/or an application <NUM>.

The input device <NUM> may receive a command and/or data to be used by the components (the processor <NUM>, etc.) of the electronic device <NUM> from the outside of the electronic device <NUM>. The input device <NUM> may include a microphone, a mouse, a keyboard, and/or a digital pen (a stylus pen, etc.).

The sound output device <NUM> may output a sound signal to the outside of the electronic device <NUM>. The sound output device <NUM> may include a speaker and/or a receiver. The speaker may be used for a general purpose, such as multimedia playing or recording playing, and the receiver may be used to receive an incoming call. The receiver may be coupled to the speaker as part of the speaker or may be realized as a separate device.

The display apparatus <NUM> may visually provide information to the outside of the electronic device <NUM>. The display apparatus <NUM> may include a display, a hologram device, or a controlling circuit for controlling a projector and a corresponding device. The display apparatus <NUM> may include touch circuitry configured to sense a touch operation and/or sensor circuitry (a pressure sensor, etc.) configured to measure an intensity of a force generated by the touch operation.

The audio module <NUM> may convert sound into an electrical signal or an electrical signal into sound. The audio module <NUM> may obtain sound via the input device <NUM> or may output sound via the sound output device <NUM> and/or a speaker and/or a headphone of an electronic device (the electronic device <NUM>, etc.) directly or wirelessly connected to the electronic device <NUM>.

The sensor module <NUM> may sense an operation state (power, temperature, etc.) of the electronic device <NUM> or an external environmental state (a user state, etc.) and generate electrical signals and/or data values corresponding to the sensed state. The sensor module <NUM> may include a gesture sensor, a gyro-sensor, an atmospheric sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, and/or an illumination sensor.

The interface <NUM> may support one or a plurality of designated protocols to be used for the electronic device <NUM> to be directly or wirelessly connected to another electronic device (the electronic device <NUM>, etc.) The interface <NUM> may include a high-definition multimedia interface (HDMI) interface, a universal serial bus (USB) interface, an SD card interface, and/or an audio interface.

A connection terminal <NUM> may include a connector, through which the electronic device <NUM> may be physically connected to another electronic device (the electronic device <NUM>, etc.) The connection terminal <NUM> may include an HDMI connector, a USB connector, an SD card connector, and/or an audio connector (a headphone connector, etc.).

A haptic module <NUM> may convert an electrical signal into a mechanical stimulus (vibration, motion, etc.) or an electrical stimulus which is recognizable to a user via haptic or motion sensation. The haptic module <NUM> may include a motor, a piezoelectric device, and/or an electrical stimulus device.

The camera module <NUM> may capture a still image and a video. The camera module <NUM> may include a lens assembly including one or a plurality of lenses, the image sensor <NUM> of <FIG>, image signal processors, and/or flashes. The lens assemblies included in the camera module <NUM> may collect light emitted from an object, an image of which is to be captured.

The power management module <NUM> may be realized as part of a power management integrated circuit (PMIC).

The battery <NUM> may supply power to the components of the electronic device <NUM>. The battery <NUM> may include a non-rechargeable primary battery, rechargeable secondary battery, and/or a fuel battery.

The communication module <NUM> may support establishment of direct (wired) communication channels and/or wireless communication channels between the electronic device <NUM> and other electronic devices (the electronic device <NUM>, the electronic device <NUM>, the server <NUM>, etc.) and communication performance through the established communication channels. The communication module <NUM> may include one or a plurality of communication processors separately operating from the processor <NUM> (an application processor, etc.) and supporting direct communication and/or wireless communication. The communication module <NUM> may include a wireless communication module <NUM> (a cellular communication module, a short-range wireless communication module, a global navigation satellite system (GNSS) communication module, and/or a wired communication module <NUM> (a local area network (LAN) communication module, a power line communication module, etc.). From these communication modules, a corresponding communication module may communicate with other electronic devices through a first network <NUM> (a short-range wireless communication network, such as Bluetooth, Wifi direct, or infrared data association (IrDa)) or a second network <NUM> (a remote communication network, such as a cellular network, the Internet, or a computer network (LAN, WAN, etc.)). Various types of communication modules described above may be integrated as a single component (a single chip, etc.) or realized as a plurality of components (a plurality of chips). The wireless communication module <NUM> may identify and authenticate the electronic device <NUM> within the first network <NUM> and/or the second network <NUM> by using subscriber information (international mobile subscriber identification (IMSI), etc.) stored in the subscriber identification module <NUM>.

The antenna module <NUM> may transmit a signal and/or power to the outside (other electronic devices, etc.) or receive the same from the outside. The antenna may include an emitter including a conductive pattern formed on a substrate (a printed circuit board (PCB), etc.). The antenna module <NUM> may include an antenna or a plurality of antennas. When the antenna module <NUM> includes a plurality of antennas, an appropriate antenna which is suitable for a communication method used in the communication networks, such as the first network <NUM> and/or the second network <NUM>, may be selected. Through the selected antenna, signals and/or power may be transmitted or received between the communication module <NUM> and other electronic devices. In addition to the antenna, another component (a radio frequency integrated circuit (RFIC), etc.) may be included in the antenna module <NUM>.

One or more of the components of the electronic device <NUM> may be connected to one another and exchange signals (commands, data, etc.) with one another, through communication methods performed among peripheral devices (a bus, general purpose input and output (GPIO), a serial peripheral interface (SPI), a mobile industry processor interface (MIPI), etc.).

The command or the data may be transmitted or received between the electronic device <NUM> and another external electronic device <NUM> through the server <NUM> connected to the second network <NUM>. Other electronic devices <NUM> and <NUM> may be electronic devices that are homogeneous or heterogeneous types with respect to the electronic device <NUM>. All or part of operations performed in the electronic device <NUM> may be performed by one or more other electronic devices <NUM>, <NUM>, and <NUM>. For example, when the electronic device <NUM> has to perform a function or a service, instead of directly performing the function or the service, the one or more other electronic devices may be requested to perform part or all of the function or the service. The one or more other electronic devices receiving the request may perform an additional function or service related to the request and may transmit a result of the execution to the electronic device <NUM>. To this end, cloud computing, distribution computing, and/or client-server computing techniques may be used.

<FIG> is a block diagram showing the camera module <NUM> of <FIG>. Referring to <FIG>, the camera module <NUM> may include a lens assembly <NUM>, a flash <NUM>, the image sensor <NUM> (see <FIG>), an image stabilizer <NUM>, a memory <NUM> (a buffer memory, etc.), and/or an image signal processor <NUM>. The lens assembly <NUM> may collect light emitted from a subject that is a target of image capture. The camera module <NUM> may include a plurality of lens assemblies <NUM>, and in this case, the camera module <NUM> may be a dual camera, a <NUM> degree camera, or a spherical camera. Some of the plurality of lens assemblies <NUM> may have the same lens property (an angle of view, a focal length, AF, a F number, optical zoom, etc.), or may have different lens properties. The lens assembly <NUM> may include a wide-angle lens or a telephoto lens.

The flash <NUM> may emit light used to enhance light emitted or reflected from a subject. The flash <NUM> may include one or more light emitting diodes (Red-Green-Blue (RGB) LED, White LED, Infrared LED, Ultraviolet LED, etc.), and/or a Xenon Lamp. The image sensor <NUM> may be the image sensor <NUM> described in <FIG>, and may obtain an image corresponding to the subject by converting the light emitted or reflected from the subject and transmitted through the lens assembly <NUM> into an electrical signal. The image sensor <NUM> may include one or a plurality of sensors selected from image sensors having different attributes, such as an RGB sensor, a black and white (BW) sensor, an IR sensor, or a UV sensor. Each of the sensors included in the image sensor <NUM> may be implemented as a Charged Coupled Device (CCD) sensor and/or a Complementary Metal Oxide Semiconductor (CMOS) sensor.

The image stabilizer <NUM> may move one or more lenses included in the lens assembly <NUM> or image sensors <NUM> in a specific direction in response to the movement of the camera module <NUM> or the electronic device <NUM> including the camera module <NUM> or control the operating characteristics of the image sensor <NUM> (adjusting read-out timing, etc.) to compensate for a negative influence due to the movement. The image stabilizer <NUM> may use a gyro sensor (not shown) or an acceleration sensor (not shown) disposed inside or outside the camera module <NUM> to detect the movement of the camera module <NUM> or the electronic device <NUM>. The image stabilizer <NUM> may be implemented optically.

The memory <NUM> may store part or entire data of an image obtained through the image sensor <NUM> for a next image processing operation. For example, when a plurality of images are obtained at high speed, obtained original data (Bayer-Patterned data, high-resolution data, etc.) may be stored in the memory <NUM>, only low-resolution images may be displayed, and then the original data of a selected (a user selection, etc.) image may be transmitted to the image signal processor <NUM>. The memory <NUM> may be integrated into the memory <NUM> of the electronic device <NUM>, or may be configured as a separate memory that operates independently.

The image signal processor <NUM> may perform one or more image processing operations on the image obtained through the image sensor <NUM> or the image data stored in the memory <NUM>. The one or more image processing operations may include depth map generation, 3D modeling, panorama generation, feature point extraction, image synthesis, and/or image compensation (noise reduction, resolution adjustment, brightness adjustment, blurring, sharpening, softening, etc.) The image signal processor <NUM> may perform control (exposure time control, read-out timing control, etc.) of components (the image sensor <NUM>, etc.) included in the camera module <NUM>. The image processed by the image signal processor <NUM> may be stored again in the memory <NUM> for further processing or may be provided to external components (the memory <NUM>, the display apparatus <NUM>, the electronic device <NUM>, the electronic device <NUM>, the server <NUM>, etc.) of the camera module <NUM>. The image signal processor <NUM> may be integrated into the processor <NUM> or may be configured as a separate processor that operates independently from the processor <NUM>. When the image signal processor <NUM> is configured as the processor separate from the processor <NUM>, the image processed by the image signal processor <NUM> may undergo additional image processing by the processor <NUM> and then be displayed through the display apparatus <NUM>.

The electronic device <NUM> may include the plurality of camera modules <NUM> having different properties or functions. In this case, one of the plurality of camera modules <NUM> may be a wide-angle camera, and the other may be a telephoto camera. Similarly, one of the plurality of camera modules <NUM> may be a front camera and the other may be a rear camera.

The image sensor <NUM> according to the embodiments may be applied to the mobile phone or a smartphone <NUM> shown in <FIG>, a tablet or a smart tablet <NUM> shown in <FIG>, a digital camera or a camcorder <NUM> shown in <FIG>, a laptop computer <NUM> shown in <FIG>, or a television or a smart television <NUM> shown in <FIG>, etc. For example, the smartphone <NUM> or the smart tablet <NUM> may include a plurality of high-resolution cameras each including a high-resolution image sensor. Depth information of objects in an image may be extracted, out condensing of the image may be adjusted, or objects in the image may be automatically identified by using the high-resolution cameras.

Also, the image sensor <NUM> may be applied to a smart refrigerator <NUM> shown in <FIG>, a surveillance camera <NUM> shown in <FIG>, a robot <NUM> shown in <FIG>, a medical camera <NUM> shown in <FIG>, etc. For example, the smart refrigerator <NUM> may automatically recognize food in the refrigerator by using the image sensor, and may notify the user of an existence of a certain kind of food, kinds of food put into or taken out, etc. through a smartphone. Also, the surveillance camera <NUM> may provide an ultra-high-resolution image and may allow the user to recognize an object or a person in the image even in dark environment by using high sensitivity. The robot <NUM> may be input to a disaster or industrial site that a person may not directly access, to provide the user with high-resolution images. The medical camera <NUM> may provide high-resolution images for diagnosis or surgery, and may dynamically adjust a field of view.

Also, the image sensor may be applied to a vehicle <NUM> as shown in <FIG>. The vehicle <NUM> may include a plurality of vehicle cameras <NUM>, <NUM>, <NUM>, and <NUM> arranged on various positions. Each of the vehicle cameras <NUM>, <NUM>, <NUM>, and <NUM> may include the image sensor according to the embodiment. The vehicle <NUM> may provide a driver with various information about the interior of the vehicle <NUM> or the periphery of the vehicle <NUM> by using the plurality of vehicle cameras <NUM>, <NUM>, <NUM>, and <NUM>, and may provide the driver with the information necessary for the autonomous travel by automatically recognizing an object or a person in the image.

Claim 1:
An image sensor (<NUM>) comprising:
a sensor substrate (<NUM>) comprising a plurality of first pixels (<NUM>) configured to sense first wavelength light in an infrared ray band and a plurality of second pixels (<NUM>, <NUM>, <NUM>) configured to sense second wavelength light in a visible light band; and
a color separating lens array (<NUM>) disposed on the sensor substrate, the color separating lens array (<NUM>) comprising a plurality of first pixel corresponding regions (<NUM>) respectively disposed to face the plurality of first pixels in a vertical direction and a plurality of second pixel corresponding regions (<NUM>, <NUM>, <NUM>) respectively disposed to face the plurality of second pixels in the vertical direction, and characterized in that
each of the plurality of first pixel corresponding regions (<NUM>) and each of the plurality of second pixel corresponding regions (<NUM>, <NUM>, <NUM>) comprise a plurality of nanoposts (NP) configured to change a phase of the first wavelength light incident on the color separating lens array such that the first wavelength light is condensed to the plurality of first pixels;
the plurality of nanoposts are configured to form a plurality of light condensing regions configured to condense the first wavelength light respectively on the plurality of first pixels;
an area of each of the plurality of light condensing regions is larger than an area of each of the plurality of first pixels; and
wherein the plurality of nanoposts have dimensions less than a shorter wavelength among first and second wavelengths.