Reflection interface for camera module

Various embodiments disclosed herein include camera equipment having a refractive index layer that causes internal reflection close to an image sensor of the camera. In some examples, internal reflection may occur at a boundary formed with the refractive index layer and located between an image sensor and an upper surface of a lens of the camera. The boundary may be formed between the refractive index layer and another material located between the refractive index layer and the image sensor, wherein the refractive index layer has a lower index of refraction than other material between the refractive index layer and the image sensor. The boundary formed with the refractive index layer may cause light to be reflected back toward the image sensor to improve image quality of images captured by the image sensor.

BACKGROUND

Technical Field

This disclosure relates generally to a refractive index layer used with a lens or collection of lens that reduces artifacts in images caused by reflection of light within a camera.

Description of the Related Art

The advent of small, mobile multipurpose devices such as smartphones and tablet or pad devices has resulted in a need for high-resolution, small form factor cameras for integration in the devices. Some small form factor cameras may include one or more lenses located on top of an image sensor. In some small form factor cameras, a set of one or more lenses with a small z-dimension may include a concave lens that reduces field curvature of images captured using the camera. However, such a set of lenses may produce an undesirable artifact in a captured image, such as a ghost ring (or lens flare) that surrounds a light source in the captured image. For example, a light source such as a streetlight, a headlight, or even a reflective object in a field of view of a camera may direct light to a focused portion of an image sensor of the camera, wherein the light directed at the focused portion of the image sensor reflects off of the image sensor and is then reflected back towards the image sensor creating an undesirable artifact, such as a ghost ring or lens flare, in an image captured by the image sensor. The undesirable artifact may be caused by internal reflection of light off of the image sensor and within the set of lenses.

It will also be understood that, although the terms first, second, etc. may be used herein to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another. For example, a first contact could be termed a second contact, and, similarly, a second contact could be termed a first contact, without departing from the intended scope. The first contact and the second contact are both contacts, but they are not the same contact.

DETAILED DESCRIPTION

Various embodiments disclosed herein include camera equipment including a camera comprising one or more lenses that includes a reflection interface at a boundary formed with a refractive index layer. The reflection interface formed with the refractive index layer is located proximate to an image sensor of the camera and reduces propagation of reflected light within the camera. The reflection interface may be an interface at a boundary between the refractive index layer and another material, such as a glass covering of an image sensor, wherein the refractive index layer has a lower index of refraction than the other material. The reduction of the propagation of reflected light within the camera may reduce or eliminate artifacts caused by light reflected within the camera, such as ghost rings, in images captured by the camera.

In some embodiments, a camera includes a lens, a refractive index layer, and an image sensor. In some embodiments, the image sensor may be coupled to glass covering and the refractive index layer may be located between the glass covering of the image sensor and the lens. In some embodiments, the camera may include a set of one or more lenses, wherein the set of lenses comprises a field flattener lens (e.g., a lens configured to reduce field curvature of an image captured via the image sensor). In some embodiments, a field flattener lens may be a concave lens that is an outer most lens of the set of lens. In some embodiments, a refractive index layer may form a boundary with one of the lenses of the set of lenses (the boundary formed with the refractive index layer may also be referred to herein as a “reflection interface”). Respective materials on either side of a boundary formed with a refractive index layer may have different optical properties, such as different refractive indexes, and the change in refractive indexes at the boundary may cause light to reflect off of the reflection interface. For example, the refractive index layer may be a layer applied to a surface of a lens on a side of the lens facing an image sensor. Also, the refractive index layer may have a lower index of refraction than another material disposed between the refractive index layer and the image sensor, such as a glass covering of the image sensor. The change in refractive indexes at the boundary formed with the refractive index layer may form a reflection interface that reflects at least some light back towards the images sensor before the light is reflected back into the lens.

Note that a refractive index of a material is a measure of how fast light propagates through the medium as compared to a speed at which light propagates through a vacuum, e.g. the speed of light in a vacuum. Thus at a boundary between two mediums having different refractive indexes, some light may bounce back at the boundary, e.g. (reflect) as opposed to changing propagation speed and refracting into the other medium on the other side of the boundary. Furthermore in some embodiments, the refractive index layer may be located between the image sensor and a lens. Thus, a reflection interface formed at the boundary between the refractive index layer and the lens may bounce back (e.g. reflect) light reflected off of the image sensor, such that the reflected light does not further propagate through the lens or additional portions of the camera. Because reflection of light off of the image sensor may be at least partially limited to a space between the image sensor and the refractive index layer that is proximate to the image sensor, a width and location of an artifact caused by the reflected light in an image captured by the image sensor may be limited. For example the size and location of the artifact may be limited such that the size and location of the artifact coincide with a light source shown in the image (such as street light), wherein the artifact does not extend significantly beyond the footprint of the light source in the captured image.

In various embodiments, a reflection interface formed with a refractive index layer may reflect at least a portion of light that has been reflected by an image sensor back towards the image sensor. For instance, a reflection interface formed with a refractive index layer may reflect a portion of light based at least in part on a difference between an index of refraction of the refractive index layer and an index of refraction of a material or medium disposed between the refractive index layer and the image sensor, such as glass covering of the image sensor. The light reflected back to the image sensor may be prevented from reaching any additional interfaces of the lens or other lens of the camera. For example, the reflection interface formed with the refractive index layer may be located such that concentrated light that is directed at a limited portion of the image sensor and reflected off of the image sensor is further reflected, by the reflection interface, back towards the limited portion of the image sensor, preventing the concreated light that is reflected off of the image sensor from being reflected back towards a larger portion of the image sensor. Said another way, at least a portion of light directed to a focus position on an image sensor and reflected off of the image sensor may be reflected back to the image sensor by a reflection boundary between a refractive index layer and another material or medium disposed between the refractive index layer and the image sensor, wherein the light reflected back to the image sensor is limited to an area of the image sensor closer to the focus position than if the light had been reflected back to the image sensor by another boundary in the camera located at a side of the lens opposite the refractive index layer.

In some embodiments, the refractive index layer may include silica beads. The silica beads may have air inside of them. Furthermore, the refractive index layer may include a binding material surrounding one or more of the silica beads.

In some embodiments, a camera may be part of a device (e.g., a mobile multifunction device). For instance, the device may further include a display and one or more processors. In some instances, the processor(s) may be configured to cause the display to present one or more images, e.g., images captured at least partly via an image sensor of the camera.

According to some examples, a camera may include an upper and lower lens assembly. The upper lens assembly may include one or more lenses held by a lens holder. In some embodiments, the lower lens assembly may be located between the lens holder of the upper lens assembly and the image sensor and may include a reflection interface at a boundary between a refractive index layer and another material, such as a glass covering of the image sensor.

In some embodiments, an image sensor of a camera may be configured to capture light that has passed through one or more lenses of the camera. In various embodiments, one or more lenses of the camera may be coupled to the image sensor. For instance, a lens may be attached to the image sensor via an adhesive. In some embodiments, the one or more lenses of the camera may include a field flattener lens (e.g., a lens configured to reduce field curvature of an image captured via the image sensor, such as a concave lens).

According to various embodiments, a camera may include a reflection interface formed with a refractive index layer and another medium of the camera, such as a lens, or glass covering of the image sensor, etc. The other medium may have a first index of refraction, and the refractive index layer may have a second index of refraction that is lower than the first index of refraction of the other medium. The reflection interface may reflect (e.g., at a location between the image sensor and an upper surface of a lens of the camera), at least a portion of light that has been reflected off of the image sensor, such that the portion of light is reflected by the reflection interface back to the image sensor. Thus, in some embodiments, light initially reflected off of the image sensor and reflected back toward the image sensor may be at least partially contained to a limited region of the image sensor, thereby reducing the size of artifacts caused by the reflected light. In some embodiments, the refractive index layer may be an air gap, wherein a first layer (e.g., a glass layer) that is attached to the image sensor, and a boundary with the air gap (e.g. the refractive index layer) on another side of the first layer may form a reflection interface at the boundary of the first layer and the air gap.

In some embodiments, a lens may be coupled to an image sensor. For instance, the lens may be adhered to the image sensor. In some embodiments, the lens may comprise a field flattener layer (e.g., a lens configured to reduce field curvature of an image captured via the image sensor, such as a concave lens). Additionally, a refractive index layer may be positioned between the lens adhered to the image sensor and another lens of the camera, wherein the refractive index layer forms a reflection interface that prevents reflected light from passing into the other lens.

In various embodiments, an interface (e.g., a reflection interface) at a boundary formed with a refractive index layer may reflect at least a portion of light that has been reflected by the image sensor, such that the portion of light is reflected by the reflection interface back to the image sensor. For instance, the reflection interface may reflect the portion of light based at least in part on a difference between an index of refraction of the refractive index layer and an index of refraction of a material that forms the boundary with the refractive index layer.

FIGS. 1A-1Beach illustrates a respective example of internal reflection within a camera, in accordance with some embodiments.FIG. 1Ashows an example100aof internal reflection within a camera that produces a ghost ring effect surrounding a light source in an image.FIG. 1Bshows an example100bof internal reflection within a camera, wherein a reflection interface located proximate to an image sensor reduces or eliminates the ghost ring effect, according to some embodiments. In some embodiments, example100aand/or example100bmay include one or multiple features, components, and/or functionality of embodiments described herein with reference toFIGS. 2-9.

In the example100ashown inFIG. 1A, the camera100may include an outer lens102and an image sensor104. The image sensor104may be configured to capture light106that has passed through the outer lens102. In some embodiments, the camera100may include a substrate108(e.g., an image sensor substrate) that is part of the image sensor104.

At least a portion of light106that passes through the outer lens102may be reflected by the image sensor104back through the outer lens102to upper surface110of the outer lens102. In some instances, light106that has been reflected by the image sensor104may further be reflected by a portion (e.g., an upper surface110) of the outer lens102back to the image sensor104, e.g., as indicated inFIG. 1A(shown as reflected portion130). Such reflection of reflected portion130by the portion (e.g. upper surface110) of the outer lens102back to the image sensor104may cause artifacts to appear in images captured by image sensor104. For example, the reflected portion130of the light106reflected off of upper surface110of outer lens102may be reflected at an angle that increases a radius of a ring (e.g. ghost ring112) formed by the reflected light. In some situations, light106may emanate from a light source in a field of view for an image being captured by camera100via image sensor104.

For example, a field of view of a camera100may include a light source, such as a street light, candle, flashlight, stadium light, or any other type of light source. In some situations a light source may be a light colored object or reflective object in a field of view of a camera100and may have any one of various shapes. Light from the light source may be focused on a focus position on the image sensor and when internally reflected within a camera may cause artifacts, such as ghost rings to appear in images captured of a scene that includes the light source. However, if the reflected light is reflected to a portion of the image sensor that captures the portion of the field of view that corresponds to the light source (as shown by light source114), the effects of the reflected light may overlap with the light source114in a captured image such that ghost rings are not perceptible or minimized in the captured image. Thus the image quality may be improved by causing any “ghost rings” to at least partially overlap with, or not extend significantly beyond, the light source (e.g. the street light, the candle, the flashlight, the stadium light, etc.) in the image such that the “ghost rings” are not perceptible in the captured image. Thus, the reflected light may be limited to an area of the image sensor closer to a focus position of the light source on the image sensor than if the light had been reflected back to the image sensor by another boundary in the camera located further away from the image sensor.

In the example100bshown inFIG. 1B, the camera150may include an outer lens116, refractive index layer122, and additional layer120. The camera150also includes an image sensor104. The image sensor104may be configured to capture light118in a field of view of the camera150, wherein the light118has passed through the outer lens116, the refractive index layer122, and the additional layer120. The additional layer120may be a glass or plastic covering of the image sensor and may have a first index of refraction, and the refractive index layer122may have a second index of refraction that is different than the first index of refraction. According to various examples, the second index of refraction of the refractive index layer122may be lower than the first index of refraction of the additional layer120. In some examples, the first index of refraction of the additional layer120may be greater than 1.4. Furthermore, in some examples, the second index of refraction of the refractive index layer122may be less than 1.3. The refractive index layer122may be considered a “low index layer” as compared to the additional layer120because the refractive index layer122may have a lower index of refraction than the additional layer120.

According to various embodiments, the additional layer120and the refractive index layer122may form a reflection interface124at a boundary between the additional layer120and the refractive index layer122. For example, the additional layer120may be a glass or plastic layer adjacent to the refractive index layer122such that the two layers meet at a boundary between the two layers that forms a reflection interface124. The reflection interface124may be configured to reflect at least a portion of light118(shown as reflected portion128) that has been reflected by the image sensor104, such that the reflected portion128is reflected by the reflection interface124back to the image sensor104, e.g., as indicated inFIG. 1B. For instance, the reflection interface124may reflect the reflected portion128of light118based at least in part on a difference between the first index of refraction of the additional layer120and the second index of refraction of the refractive index layer122. Such reflection by the reflection interface124back to the image sensor104may be an internal reflection that produces little to no ghost ring. For instance, the ghost ring produced by the reflected light128in example100b(FIG. 1B) may be less than the ghost ring produced by the reflected light130in example100a(FIG. 1A). In various embodiments, the reflection interface124between the additional layer120and the refractive index layer122may be located proximate to the image sensor104. As such, the size of the ghost ring produced by the reflected light128in example100bmay not be significantly larger than the size of the light source126in the image captured via the image sensor104, and thus the ghost ring may appear as part of the light source126in the image.

In some embodiments, the materials of the additional layer120and the refractive index layer122may be configured such that the difference in refractive indexes of the two layers at the boundary between the two layers, e.g. the reflection interface124, causes total internal reflection (TIR) of reflected light.

FIG. 2illustrates an example200of how internal reflection within may affect ghost ring size, in accordance with some embodiments. In some embodiments, example200may include one or multiple features, components, and/or functionality of embodiments described herein with reference toFIGS. 1A, 1B, and 3-9.

In some embodiments, a camera may include a glass layer202and an image sensor204as shown inFIG. 2. The image sensor204may be configured to capture light206that has passed through the glass layer202. In some embodiments, a glass layer202may have a first index of refraction (“Index1”)208. Another portion of the camera above the glass layer202, such as a refractive index layer, may have a second index of refraction (“Index2”)210. For instance, the portion above glass layer202may be an air gap216comprising air (or in some embodiments another gas other than air) that has a different index of refraction than the glass layer202. The air gap may function as a refractive index layer and form a boundary with the glass layer202that function as a reflection interface. In some examples, the second index of refraction210of the air gap216may be lower than the first index of refraction208of the glass layer202.

Total internal reflection (TIR) may occur when a propagated wave (such as light passing through glass layer202) strikes a boundary (such as a boundary between glass layer202and air gap216, e.g. a reflection interface) at an angle larger than a TIR angle. As shown inFIG. 2, when reflected light portion218strikes the reflection interface formed by the boundary of glass layer202and air gap216at an angle equal to or greater than the TIR angle212, the reflected light portion218is reflected off of the boundary between the glass layer202and air gap216. In comparison, as shown inFIG. 1Bsome of internally reflected light128that strikes reflection interface124at an angle less than a TIR angle may pass through the reflection interface124. However, such reflected light that passes through the reflection interface124inFIG. 1Bmay exit the camera150, or if reflected at the interface of outer lens116and air surrounding outer lens116, the amount of reflected light may be negligible.

In some examples, the TIR angle212may be characterized as:

TIR angle=sin−1(Index2/Index1), where index 1 is a refractive index of a first layer and index 2 is a refractive index of a second layer, wherein the first layer and the second layer form a reflective interface at a boundary between the layers. For example, index 1 may be first index of refraction208and index 2 may be second index of refraction210.

Furthermore, in some examples, the ring diameter214of a ghost ring produced by the TIR of reflected light portion218may be characterized as:

ring diameter=tan{sin−1(Index2/Index1)}●thickness●4, where

“thickness” is the thickness220of the glass layer202inFIG. 2. In some embodiments, the thickness220may be a vertical distance from the image sensor204to the interface between the layer having the first index of refraction208and the air gap or other type of refractive index layer having the second index of refraction210.

FIG. 3illustrates a schematic cross-sectional view of an example image sensor package300that includes a refractive index layer that forms a reflection interface, in accordance with some embodiments. In some embodiments, the image sensor package300may include one or multiple features, components, and/or functionality of embodiments described herein with reference toFIGS. 1A-2 and 4-9.

In some embodiments, the image sensor package300may include an image sensor304, a refractive index layer310and a glass (or plastic) layer312. The image sensor304may be configured to capture light that has passed through the glass layer312. An adhesive308may attach the glass layer312with attached refractive index layer310to the image sensor304. In some embodiments, the image sensor package300may comprise field flattener lens (e.g., a lens configured to reduce field curvature of an image captured via the image sensor304, such as a concave lens). However, the sensor package300may include other types of lens in other embodiments. The image sensor package300may include a refractive index layer310that has a first index of refraction. Furthermore, the image sensor package300may include an additional layer, such as a glass layer312, that has a second index of refraction that is lower than the first index of refraction of the refractive index layer310.

According to various embodiments, the refractive index layer310and the glass layer312may interface at a reflection interface314. In various embodiments, the reflection interface314may reflect at least a portion of light that has been reflected by the image sensor304, such that the portion of light is reflected by the reflection interface314back to the image sensor304. For instance, the reflection interface314may reflect the portion of light based at least in part on a difference between the first index of refraction of the refractive index layer310and a second index of refraction of the glass layer312.

In some examples, the refractive index layer310, the glass layer312, and/or the reflection interface314may be located proximate to the image sensor304. For example, the reflection interface314may be located closer to the image sensor304than to an upper surface of the glass layer312.

In some embodiments, at least a portion of the refractive index layer310that has the first index of refraction may extend along a first plane, and at least a portion of the additional layer, e.g. the glass layer312that has the second index of refraction, may extend along a second plane that is substantially parallel to the first plane. The first plane may be located between the image sensor304and the second plane. Furthermore, the second plane may be located between the first plane and an upper surface of the glass layer312. In various embodiments, the image sensor may define a plane that is substantially parallel to the first plane and/or the second plane.

In some embodiments, an image sensor, such as image sensor304, may include one or more on chip mounted lenses306. In some embodiments, an adhesive308may attach the glass layer312with attached refractive index layer310to the on chip lenses306of the image sensor304.

FIG. 4illustrates a cross-sectional view of an example low refractive index layer400that may be used in a camera having a reflection interface, in accordance with some embodiments. In some embodiments, the low refractive index layer400may include one or multiple features, components, and/or functionality of embodiments described herein with reference toFIGS. 1A-3 and 5-9.

In some embodiments, the low refractive index layer400may include one or more beads402(e.g., silica beads). According to some examples, the beads402may be hollow and/or have air404inside of them. The low index layer400may have a low index of refraction as compared to another layer of a camera, such as a glass layer of an image sensor, based at least in part on air404within the beads402. For example, air may have a refractive index of approximately 1, whereas glass may have a refractive index greater than air, such as 1.3-1.5, as an example. In some embodiments, one or more of the beads402may be surrounded by a binding material406.

In some non-limiting examples, the low index layer400may form at least part of refractive index layer122(FIG. 1B), refractive index layer310(FIG. 3), and/or refractive index layer510(FIG. 5).

FIG. 5illustrates a schematic cross-sectional view of an example camera500that includes a reflection interface, in accordance with some embodiments. In some embodiments, the camera500may include one or multiple features, components, and/or functionality of embodiments described herein with reference toFIGS. 1A-4 and 6-9.

In some embodiments, the camera500may include an upper lens assembly520, a lower lens assembly530, and an image sensor506. The image sensor506may be configured to capture light that has passed through the upper lens assembly520and the lower lens assembly530. The upper lens assembly520may include one or more lenses502that are held by a lens holder508in some embodiments. The lower lens assembly530may include a lens504located between the image sensor506and the upper lens assembly520, and/or between the image sensor506and the lens holder508. In some examples, the lens504of the lower lens assembly530may be coupled to the image sensor506. For instance, the lens504of the lower lens assembly530may be attached to the image sensor506via an adhesive, e.g., as discussed above with reference toFIG. 3.

In some cases, the lens504of the lower lens assembly530may be a concave lens, e.g., as indicated inFIG. 5. Additionally, or alternatively, the lens504of the lower lens assembly530may be a field flattener lens that is configured to reduce field curvature of an image captured via the image sensor506.

According to various embodiments, the camera and lens system500may include a reflection interface510. For instance, the reflection interface510may be an interface between a glass layer512of the lower lens assembly530and a refractive index layer514. The glass layer512may have a first index of refraction. The refractive index layer514may have a second index of refraction. In some embodiments, the refractive layer514may have a lower index of refraction than the glass layer512. In some examples, the first index of refraction of the glass layer512may be greater than 1.4, and the second index of refraction of the refractive index layer514may be less than 1.3.

In some examples, the reflection interface510may reflect at least a portion of light that has been reflected by the image sensor506, such that the portion of light is reflected by the reflection interface510back to the image sensor506. Also, in some embodiments, the reflection interface510may produce total internal reflection (TIR). For instance, total internal reflection may occur at a location between the image sensor506and an upper surface of the lens504.

In some embodiments, the glass layer512and the refractive index layer514may be coupled with lens504, e.g., as indicated inFIG. 5. However, in some embodiments, the glass layer512and/or the refractive index layer514may be separated from an additional lens layer. For instance, as discussed below with reference toFIG. 6, the glass layer512may be attached to the image sensor504, and a reflection interface may be formed at a boundary between the glass layer512and an air gap.

In some embodiments, an image sensor assembly may include a substrate516(e.g., an image sensor substrate) that is part of the image sensor, wherein the image sensor includes a light receiving part and a logic area, wherein the substrate516is coupled to the logic area of the image sensor and the portion of the image sensor labeled as506comprises the light receiving portion. Furthermore, in some embodiments, the camera500may include a filter518(e.g., an infrared filter). The filter518may be located between the one or more lenses502of the upper lens assembly520and the lens504of the lower lens assembly530, in some embodiments. As such, in some instances, light may pass through the one or more lenses502of the upper lens assembly520, then through the filter518, then through the components of the lower lens assembly530, and to the image sensor506. It should be understood, however, that the filter518may be located differently in other embodiments. As an example, the filter518may be located above the one or more lenses502of the upper lens assembly520. As another example, the filter518may be located below the lens504of the lower lens assembly530.

According to some embodiments, the camera module500may include one or more actuators (not shown) to move the one or more lenses502of the upper lens assembly520, one or more actuators (not shown) to move the lens504of the lower lens assembly530, and/or one or more actuators (not shown) to move the image sensor506. The actuator(s) may be used to provide autofocus (AF) and/or optical image stabilization (OIS) functionality. In some cases, the actuator(s) may include one or more voice coil motor (VCM) actuators that include one or more magnets and one or more coils. The magnet(s) and coil(s) may magnetically interact to produce Lorentz forces that move the one or more lenses502of the upper lens assembly520, the lens504of the lower lens assembly530, and/or the image sensor506. As an example, the camera and lens system500may include a VCM actuator to move the one or more lenses502of the upper lens assembly520, relative to the lower lens assembly530and/or the image sensor506, along an optical axis to provide AF movement. As another example, the VCM actuator may be configured to move the one or more lenses502of the upper lens assembly, relative to the lower lens assembly530and/or the image sensor506, in directions orthogonal to the optical axis to provide OIS movement.

FIG. 6illustrates a schematic cross-sectional view of another example camera600that includes a reflection interface, in accordance with some embodiments. In some embodiments, the camera600may include one or multiple features, components, and/or functionality of embodiments described herein with reference toFIGS. 1A-5 and 7-9.

In some embodiments, the camera600may include a lens602and an image sensor604. The image sensor604may be configured to capture light that has passed through the lens602. In some embodiments, the lens602may be a concave lens or other type of field flattening lens that is configured to reduce field curvature of an image captured via the image sensor604.

According to some embodiments, the camera600may include a reflection interface606at a boundary between a first layer608and a gap layer610, e.g. an air gap. For instance, the reflection interface606may be an interface between a first layer608and a gap portion610. The gap portion, such as gap portion610, may function as a refractive index layer. The first layer608may have a first index of refraction, and the gap portion610may have a second index of refraction that is lower than the first index of refraction. For instance, the first layer608may be a glass layer attached to the image sensor604, and the gap portion610may be a gap located between the first layer608and the lens602. In some embodiments, the gap portion may comprise air, or other gasses, such as nitrogen, helium, hydrogen, etc. In some embodiments, a gap portion may be a vacuum layer. In some embodiments, a lower surface of a glass layer (first layer608) may be attached to the image sensor604. An upper surface of the glass layer may be spaced apart from a lower surface of the lens602via one or more spacers612to form the gap layer (gap portion610). A portion of the upper surface of the glass layer may be coupled to a portion of the lower surface of the lens602via the spacer(s)612.

In some embodiments, the image sensor604may include a substrate614(e.g., an image sensor substrate) that is part of the image sensor604. In some cases, the camera600may include a filter (e.g., an infrared filter). For instance, the filter may be the first layer608in some embodiments.

FIG. 7illustrates a block diagram of an example portable multifunction device700that may include a camera having a reflection interface, in accordance with some embodiments. In some embodiments, the portable multifunction device700may include one or multiple features, components, and/or functionality of embodiments described herein with reference toFIGS. 1-6, 8, and 9.

Camera(s)764is sometimes called an “optical sensor” for convenience, and may also be known as or called an optical sensor system. Device700may include memory702(which may include one or more computer readable storage mediums), memory controller722, one or more processing units (CPUs)720, peripherals interface718, RF circuitry708, audio circuitry710, speaker711, touch-sensitive display system712, microphone713, input/output (I/O) subsystem706, other input or control devices716, and external port724. Device700may include one or more optical sensors764. These components may communicate over one or more communication buses or signal lines703.

It should be appreciated that device700is only one example of a portable multifunction device, and that device700may have more or fewer components than shown, may combine two or more components, or may have a different configuration or arrangement of the components. The various components shown inFIG. 7may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits.

Memory702may include high-speed random access memory and may also include non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid-state memory devices. Access to memory702by other components of device700, such as CPU720and the peripherals interface718, may be controlled by memory controller722.

Peripherals interface718can be used to couple input and output peripherals of the device to CPU720and memory702. The one or more processors720run or execute various software programs and/or sets of instructions stored in memory702to perform various functions for device700and to process data.

In some embodiments, peripherals interface718, CPU720, and memory controller722may be implemented on a single chip, such as chip704. In some other embodiments, they may be implemented on separate chips.

Audio circuitry710, speaker711, and microphone713provide an audio interface between a user and device700. Audio circuitry710receives audio data from peripherals interface718, converts the audio data to an electrical signal, and transmits the electrical signal to speaker711. Speaker711converts the electrical signal to human-audible sound waves. Audio circuitry710also receives electrical signals converted by microphone713from sound waves. Audio circuitry710converts the electrical signal to audio data and transmits the audio data to peripherals interface718for processing. Audio data may be retrieved from and/or transmitted to memory702and/or RF circuitry708by peripherals interface718. In some embodiments, audio circuitry710also includes a headset jack (e.g.,812,FIG. 8). The headset jack provides an interface between audio circuitry710and removable audio input/output peripherals, such as output-only headphones or a headset with both output (e.g., a headphone for one or both ears) and input (e.g., a microphone).

I/O subsystem706couples input/output peripherals on device700, such as touch screen712and other input control devices716, to peripherals interface718. I/O subsystem706may include display controller756and one or more input controllers760for other input or control devices. The one or more input controllers760receive/send electrical signals from/to other input or control devices716. The other input control devices716may include physical buttons (e.g., push buttons, rocker buttons, etc.), dials, slider switches, joysticks, click wheels, and so forth. In some alternate embodiments, input controller(s)760may be coupled to any (or none) of the following: a keyboard, infrared port, USB port, and a pointer device such as a mouse. The one or more buttons (e.g.,808,FIG. 8) may include an up/down button for volume control of speaker711and/or microphone713. The one or more buttons may include a push button (e.g.,806,FIG. 8).

Touch-sensitive display712provides an input interface and an output interface between the device and a user. Display controller756receives and/or sends electrical signals from/to touch screen712. Touch screen712displays visual output to the user. The visual output may include graphics, text, icons, video, and any combination thereof (collectively termed “graphics”). In some embodiments, some or all of the visual output may correspond to user-interface objects.

Touch screen712has a touch-sensitive surface, sensor or set of sensors that accepts input from the user based on haptic and/or tactile contact. Touch screen712and display controller756(along with any associated modules and/or sets of instructions in memory702) detect contact (and any movement or breaking of the contact) on touch screen712and converts the detected contact into interaction with user-interface objects (e.g., one or more soft keys, icons, web pages or images) that are displayed on touch screen712. In an example embodiment, a point of contact between touch screen712and the user corresponds to a finger of the user.

Device700also includes power system762for powering the various components. Power system762may include a power management system, one or more power sources (e.g., battery, alternating current (AC)), a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator (e.g., a light-emitting diode (LED)) and any other components associated with the generation, management and distribution of power in portable devices.

Device700may also include one or more optical sensors or cameras764.FIG. 7shows an optical sensor764coupled to optical sensor controller758in I/O subsystem706. Optical sensor764may include charge-coupled device (CCD) or complementary metal-oxide semiconductor (CMOS) phototransistors. Optical sensor764receives light from the environment, projected through one or more lens, and converts the light to data representing an image. In conjunction with imaging module743(also called a camera module), optical sensor764may capture still images or video. In some embodiments, an optical sensor764is located on the back of device700, opposite touch screen display712on the front of the device, so that the touch screen display712may be used as a viewfinder for still and/or video image acquisition. In some embodiments, another optical sensor is located on the front of the device so that the user's image may be obtained for videoconferencing while the user views the other video conference participants on the touch screen display.

Device700may also include one or more proximity sensors766.FIG. 7shows proximity sensor766coupled to peripherals interface718. Alternately, proximity sensor766may be coupled to input controller760in I/O subsystem706. In some embodiments, the proximity sensor766turns off and disables touch screen712when the multifunction device700is placed near the user's ear (e.g., when the user is making a phone call).

Device700includes one or more orientation sensors768. In some embodiments, the one or more orientation sensors768include one or more accelerometers (e.g., one or more linear accelerometers and/or one or more rotational accelerometers). In some embodiments, the one or more orientation sensors768include one or more gyroscopes. In some embodiments, the one or more orientation sensors768include one or more magnetometers. In some embodiments, the one or more orientation sensors768include one or more of global positioning system (GPS), Global Navigation Satellite System (GLONASS), and/or other global navigation system receivers. The GPS, GLONASS, and/or other global navigation system receivers may be used for obtaining information concerning the location and orientation (e.g., portrait or landscape) of device700. In some embodiments, the one or more orientation sensors768include any combination of orientation/rotation sensors.FIG. 7shows the one or more orientation sensors768coupled to peripherals interface718. Alternately, the one or more orientation sensors768may be coupled to an input controller760in I/O subsystem706. In some embodiments, information is displayed on the touch screen display712in a portrait view or a landscape view based on an analysis of data received from the one or more orientation sensors768.

In some embodiments, the software components stored in memory702include operating system726, communication module (or set of instructions)728, contact/motion module (or set of instructions)730, graphics module (or set of instructions)732, text input module (or set of instructions)734, Global Positioning System (GPS) module (or set of instructions)735, arbiter module758and applications (or sets of instructions)736. Furthermore, in some embodiments memory702stores device/global internal state757. Device/global internal state757includes one or more of: active application state, indicating which applications, if any, are currently active; display state, indicating what applications, views or other information occupy various regions of touch screen display712; sensor state, including information obtained from the device's various sensors and input control devices716; and location information concerning the device's location and/or attitude.

Communication module728facilitates communication with other devices over one or more external ports724and also includes various software components for handling data received by RF circuitry708and/or external port724. External port724(e.g., Universal Serial Bus (USB), FIREWIRE, etc.) is adapted for coupling directly to other devices or indirectly over a network (e.g., the Internet, wireless LAN, etc.). In some embodiments, the external port is a multi-pin (e.g., 30-pin) connector.

Contact/motion module730may detect contact with touch screen712(in conjunction with display controller756) and other touch sensitive devices (e.g., a touchpad or physical click wheel). In some embodiments, contact/motion module730and display controller756detect contact on a touchpad. Contact/motion module730may detect a gesture input by a user. Different gestures on the touch-sensitive surface have different contact patterns. Graphics module732includes various known software components for rendering and displaying graphics on touch screen712or other display, including components for changing the intensity of graphics that are displayed. As used herein, the term “graphics” includes any object that can be displayed to a user, including without limitation text, web pages, icons (such as user-interface objects including soft keys), digital images, videos, animations and the like. Text input module734, which may be a component of graphics module732, provides soft keyboards for entering text in various applications (e.g., contacts, e-mail, and any other application that needs text input). GPS module735determines the location of the device and provides this information for use in various applications736(e.g., to a camera application as picture/video metadata).

Applications736may include one or more modules (e.g., a contacts module, an email client module, a camera module for still and/or video images, etc.) Examples of other applications736that may be stored in memory702include other word processing applications, other image editing applications, drawing applications, presentation applications, JAVA-enabled applications, encryption, digital rights management, voice recognition, and voice replication. Each of the modules and applications correspond to a set of executable instructions for performing one or more functions described above and the methods described in this application (e.g., the computer-implemented methods and other information processing methods described herein). These modules (i.e., sets of instructions) need not be implemented as separate software programs, procedures or modules, and thus various subsets of these modules may be combined or otherwise re-arranged in various embodiments. In some embodiments, memory702may store a subset of the modules and data structures identified above. Furthermore, memory702may store additional modules and data structures not described above.

FIG. 8depicts an example portable multifunction device700that may include a camera having a reflection interface, in accordance with some embodiments. In some embodiments, the portable multifunction device700may include one or multiple features, components, and/or functionality of embodiments described herein with reference toFIGS. 1-7 and 9.

The device700may have a touch screen712. The touch screen712may display one or more graphics within user interface (UI)800. In this embodiment, as well as others described below, a user may select one or more of the graphics by making a gesture on the graphics, for example, with one or more fingers802(not drawn to scale in the figure) or one or more styluses803(not drawn to scale in the figure).

Device700may also include one or more physical buttons, such as “home” or menu button804. As described previously, menu button804may be used to navigate to any application736in a set of applications that may be executed on device700. Alternatively, in some embodiments, the menu button804is implemented as a soft key in a GUI displayed on touch screen712.

In one embodiment, device700includes touch screen712, menu button804, push button806for powering the device on/off and locking the device, volume adjustment button(s)808, Subscriber Identity Module (SIM) card slot810, head set jack812, and docking/charging external port724. Push button806may be used to turn the power on/off on the device by depressing the button and holding the button in the depressed state for a predefined time interval; to lock the device by depressing the button and releasing the button before the predefined time interval has elapsed; and/or to unlock the device or initiate an unlock process. In an alternative embodiment, device700also may accept verbal input for activation or deactivation of some functions through microphone713.

It should be noted that, although many of the examples herein are given with reference to optical sensor(s)/camera(s)764(on the front of a device), one or more rear-facing cameras or optical sensors that are pointed opposite from the display may be used instead of, or in addition to, an optical sensor(s)/camera(s)764on the front of a device.

FIG. 9illustrates an example computer system900that may include a camera having a reflection interface, in accordance with some embodiments. In some embodiments, the computer system900may include one or multiple features, components, and/or functionality of embodiments described herein with reference toFIGS. 1-8.

Various embodiments of a camera motion control system as described herein, including embodiments of magnetic position sensing, as described herein may be executed in one or more computer systems900, which may interact with various other devices. Note that any component, action, or functionality described above with respect toFIGS. 1-14may be implemented on one or more computers configured as computer system900ofFIG. 9, according to various embodiments. In the illustrated embodiment, computer system900includes one or more processors910coupled to a system memory920via an input/output (I/O) interface930. Computer system900further includes a network interface940coupled to I/O interface930, and one or more input/output devices950, such as cursor control device960, keyboard970, and display(s)980. In some cases, it is contemplated that embodiments may be implemented using a single instance of computer system900, while in other embodiments multiple such systems, or multiple nodes making up computer system900, may be configured to host different portions or instances of embodiments. For example, in one embodiment some elements may be implemented via one or more nodes of computer system900that are distinct from those nodes implementing other elements.

In various embodiments, computer system900may be a uniprocessor system including one processor910, or a multiprocessor system including several processors910(e.g., two, four, eight, or another suitable number). Processors910may be any suitable processor capable of executing instructions. For example, in various embodiments processors910may be general-purpose or embedded processors implementing any of a variety of instruction set architectures (ISAs), such as the x86, PowerPC, SPARC, or MIPS ISAs, or any other suitable ISA. In multiprocessor systems, each of processors910may commonly, but not necessarily, implement the same ISA.

System memory920may be configured to store camera control program instructions922and/or camera control data accessible by processor910. In various embodiments, system memory920may be implemented using any suitable memory technology, such as static random access memory (SRAM), synchronous dynamic RAM (SDRAM), nonvolatile/Flash-type memory, or any other type of memory. In the illustrated embodiment, program instructions922may be configured to implement a lens control application924incorporating any of the functionality described above. Additionally, existing camera control data932of memory920may include any of the information or data structures described above. In some embodiments, program instructions and/or data may be received, sent or stored upon different types of computer-accessible media or on similar media separate from system memory920or computer system900. While computer system900is described as implementing the functionality of functional blocks of previous Figures, any of the functionality described herein may be implemented via such a computer system.

Input/output devices950may, in some embodiments, include one or more display terminals, keyboards, keypads, touchpads, scanning devices, voice or optical recognition devices, or any other devices suitable for entering or accessing data by one or more computer systems900. Multiple input/output devices950may be present in computer system900or may be distributed on various nodes of computer system900. In some embodiments, similar input/output devices may be separate from computer system900and may interact with one or more nodes of computer system900through a wired or wireless connection, such as over network interface940.

As shown inFIG. 9, memory920may include program instructions922, which may be processor-executable to implement any element or action described above. In one embodiment, the program instructions may implement the methods described above. In other embodiments, different elements and data may be included. Note that data may include any data or information described above.