Optical input using internal reflection surfaces

An optical navigation device for a computer application includes a radiation source capable of producing a beam of radiation, a sensor for receiving an image, and an optical element for identifying movement of the feature to thereby enable a computer action to be carried out. The optical element is formed from a single piece and includes at least one frustrated total internal reflection (F-TIR) surface capable of affecting frustrated total internal reflection of the beam of radiation in the presence of the feature to thereby generate the image.

PRIORITY CLAIM

The present invention claims priority from British Patent Application No. 0908899.8 filed May 26, 2009 and British Patent Application No. 0913000.6 filed Jul. 27, 2009, the disclosures of which are hereby incorporated by reference.

BACKGROUND

1. Technical Field

The present invention relates to improvements in or relating to optical navigation devices, particularly but not exclusively in respect to miniature devices for use in a variety of different applications.

2. Description of Related Art

Current mobile or computer devices use a variety of different navigation mechanisms. Touch screen panels are navigated by means of direct contact with screen. Other devices make use of trackball devices where a mechanical signal is translated into position data to enable the navigation to occur. A further navigation device makes use of a multi-click joystick to enable the necessary navigation. There are problems associated with each of the currently available navigation mechanisms. The touch screen panel has been shown to be somewhat unreliable while the trackball and joystick may also be unreliable as well as relatively expensive to implement.

For larger scale computer devices optical mice have been used for some time for navigation purposes. These devices are generally too large and impractical for mobile applications due to ergonomic and economic issues. In addition, miniaturization of typical optical mice has not proved successful to date.

There is a need to overcome at least some of the problems associated with the prior art.

There is further a need to apply optical mouse technology to the mobile computer domain.

SUMMARY

According to one aspect there is provided an optical navigation device for a computer application, comprising: a radiation source capable of producing a beam of radiation; a sensor for receiving an image; an optical element for identifying movement of a feature to thereby enable a control action to be carried out; wherein the optical element is formed from a single piece construction and includes at least one frustrated total internal reflection (F-TIR) surface capable of causing frustrated total internal reflection of the beam of radiation in the presence of the feature to thereby generate the image which is capable of being translated into said control action.

In a further aspect there is provided computer device, or a mobile telephone comprising the optical navigation device herein described, wherein the term “computer device” is to be construed as including at least: mobile telephones, mobile media players, such as MP3 players, TV/DVD remote control, SatNav systems, digital cameras etc.

DETAILED DESCRIPTION OF THE DRAWINGS

An optical navigation device module is presented for use in a device. The device may be of any appropriate type and may include mobile phones, PDAs, Laptop computers, TV remotes, games controls and other such devices herein referred to as a computer application.

Referring toFIG. 1, an optical navigation device module100is shown. The optical navigation device module100includes a base plate102, an optical element106which incorporates a clip104(the optical element will be described in greater detail below), an illumination source108, such as an LED, and a sensor110. The clip104makes a snap fit connection with the base plate102. The nature of the mechanical engagement is discussed in greater detail in United Kingdom Patent Application No. 0908900.4 of 26 May 2009, the disclosure of which is incorporated by reference. The overall construction of the optical navigation device module100is of a low profile construction making it suitable for mobile devices. The actual size of the overall package containing the optical navigation device sits under a cap of about 7 mm in diameter and the module itself has a maximum dimension of about 5.8 mm.

The optical element106may be molded from a single piece of plastic and provides a so called mousing surface112. An example of the type of plastic material is a monolithic optical block made of a plastics material such as poly (methyl methacrylate) also known as PMMA; although it will be appreciated other materials (such as Polycarbonate, Cyclcyclophane copolymer) may alternatively be used.

The optical navigation device module100is essentially split into three main functions or components: an optical interface to the mousing surface112; the adaptation of the optical elements to provide additional advantages in terms of mechanical construction; and the interface of the mouse or optical navigation device with the user. The specific optical design maximizes the accuracy of the navigation process in a low profile package. The optics also enable the mechanical advantages that are described in the United Kingdom Patent Application No. 0908900.4 of 26 May 2009.

Referring now toFIG. 2, an embodiment of the optical system can be seen in more detail. This embodiment shows the optical layout for a frustrated total internal reflection (F-TIR) device200, although direct imaging systems and other systems are equally applicable to be used in place of the F-TIR device200.

The F-TIR device200includes an LED202which emits a source of radiation directed by optical element204to the internal surface210of the mousing surface112. A further optical element208then directs any reflected radiation from surface210on to sensor206.

The LED202may be of any appropriate type and may be mounted on a substrate. In a particular example the LED emits in the near infrared range for example between about 700 to 900 nm. It should be noted that the radiation emitted by the LED may be any appropriate wavelength. If the radiation is in the UV, optical or IR ranges the radiation may be referred to as illumination.

The optical element204directs the LED illumination into the monolithic optical block which forms the optical element106. The optical element204may be shaped as appropriate to form for example a single convex surface; a series of lenslets configured as a “fly eye” structure; or any other suitable structure capable of providing near collimated or near focused illumination at the internal surface210. The optical element204may be capable of being tilted in order to control the illumination pattern and direction of the beam at the mousing surface. Since optical element204is part of an illumination system the use of a single tilted surface can be extended to a multiple lenslet system (also known as a “fly-eye lens”), where the individual lenslets can be tilted to improve control of the illumination pattern at the mousing surface112. A fly-eye lens is shown inFIGS. 7aand7band is formed from a number of lenslets700, which replace optical element204. The fly-eye lens allows for a more compact design as well as the improved illumination distribution. The fly-eye lens is particularly useful in the case where the radiation source202is an LED giving an incoherent, wide angle pseudo-Gaussian intensity pattern. It will be appreciated that different forms of fly-eye lens may be used, for example different numbers of controllable lenslets and different orientations of the lenslets.

The mousing surface112includes an internal surface210and an external surface212. At the mousing surface any object with a refractive index which is placed in contact with the external surface212will frustrate the total internal reflection of the beams214at the internal surface210. A suitable object may include a finger, pointer, hand or other object or feature. A so-called frustrated reflection will thus be generated and the resulting pattern is focused by optical element208onto the sensor206.

The internal surface210is relatively smooth when compared to the features which give rise to the F-TIR. Illumination reflected from the internal surface210when there is no object close to the mousing surface is virtually 100% reflected. However, when the reflection is frustrated only about 10% or less of the illumination is reflected, thus resulting in contrast ratio of about 1:10 in the present example. Note that at 850 nm most of returned signal is from scattering at the object in contact with the optical element106(e.g. the skin of the user's finger).

The optical element208may be of any appropriate form, for example a single convex surface; and includes a stop (not shown) so that an image of F-TIR surface is produced at the sensor.

Ideally the optical stop on208is such that its numerical aperture matches that of the rest of the system. The numerical aperture of the system can be dictated by several means. Firstly it can be generated by surface texture on the mousing surface112being such that it scatters the incident collimated radiation into a given angular profile. In this case the optical element208focuses the radiation from mousing surface112onto the sensor206. Also the stop can be generated by having a similar texture to any of the other surfaces intervening between the LED source202and lens208, including the LED transparent package surface. In these cases, the lens208focuses the light from the mousing surface112onto the sensor206and the F-TIR pattern is seen as a occlusion to the true image. The LED202may be replaced by an extended light source, such as an organic light emitter, which on viewing from the sensor206subtends the sensor area. In this case the surface of the light source is imaged at the sensor206by way of the lens208. Alternatively the aperture end of the collimating lens204may be extended to allow all imaged points of the mousing surface112to be subject to radiation at all angles presented to the collimating lens204by the extended source. This allows the lens208to image the mousing surface112onto the sensor206.

The sensor206may be any appropriate type and is designed to be of maximum size within the constraints of the package. In one embodiment the sensor is made up of an array of (20×20) 30 μm pixels. Other sizes and resolutions of sensor or pixels may be used instead.

The frustrated reflection directed on to the sensor is detected in order to identify the point or points of contact of the object in contact with the external surface212. Subsequent measurements of the point or points of contact will provide information corresponding to the movement of object on the external surface212. The action or movement of the object can then be translated into actions to operate a mobile personal computer.

The system works at a frame rate of 1 to 10 kHz in order to detect relative movement or movements of one or more features at the F-TIR. The features detected at the F-TIR are features between about 0.5 mm and 30 μm in size and correspond, for example, to finger print features of a user. The smaller features provide a greater ability to detect motion than the larger ones. To detect features of about 30 μm, an increased resolution of the sensor and an increased quality of the optics used in the F-TIR device200can be advantageous. The sensor operates to determine motion vectors of one or more features from one frame to the next in accordance with the frame rate. Correlation from one frame to the next identifies the motion vectors and rate of movement which can then be translated into an appropriate control action for the mobile computer.

The frame rate is set by the refresh rate of the sensor. The exposure may be achieved by a pulsating illumination source (LED) or by sampling the sensor output at the required rate.

It may be possible to calibrate the sensor by determining the sensor illumination when there is no radiation source for F-TIR and comparing this with the sensor, when detecting F-TIR. This calibration may occur at the start of each use of the optical navigation device or on a frame to frame basis.

FIG. 3shows a ray diagram to illustrate the passage of beams of illumination within the optical navigation device. The optic element106includes certain surfaces300and302which are total internal reflection (TIR) folded surfaces. Surface300reflects illumination from the LED light source202to the frustrated total internal reflection (F-TIR) mousing surface112where a frustrated total internal reflection occurs. The beam generated by the frustrated total internal reflection is then reflected on TIR fold surface302onto the mouse sensor206.

The relative positions and angles between the TIR surfaces and the F-TIR mousing surface are shown inFIG. 3to be at approximately 60° to the direction of travel of the light. However, it will be appreciated other orientations of the various surfaces may alternatively be used and may also have an impact on the overall size of the package. The precise orientation and size of the overall mouse device can be adjusted by changing the geometry and shapes of the various surfaces. For example in the diagram the mousing surface forms part of the dome of low curvature. However, a flat surface may replace the domed surface that is shown. Also the TIR surfaces (300and302) may be gently curved to augment the focusing of the lenses within the system. The surfaces may be adjusted to allow the use of a high angle of incidence for the main beam which allows a greater angular spread of radiation to be handled. In addition this ensures that a greater intensity of radiation is delivered to the F-TIR surface which maximizes the level of the radiation on the F-TIR surface within the constraints of size of the overall package. This is important to ensure adequate responsiveness and reaction time within the optical navigation device. As an alternative, if the TIR surfaces are at 45°, the amount of radiation on the F-TIR will be suboptimal. Accordingly, the range of angles for the TIR surfaces should be in the range 50° and 80°. In the example shown inFIG. 3the arrangement provides a distance from the base to the F-TIR surface in the region of 3.5 mm and a distance between the two TIR folding surfaces in the region of 5.8 mm, thus giving rise to a compact package.

As previously indicated, the angles and positions of the folding TIR and F-TIR surfaces can be adjusted. One such adjustment is to replace TIR fold surface300with a biconic surface and adjust the angle of incidence to optimize the irradiance at the F-TIR surface. This can serve to reduce the overall size of the package containing the optical navigation device.

The system magnification for the optical navigation device is in the region of −1 to −0.1; although a preferred value is in the range −0.8 to −0.3.

FIG. 3also shows details of the black plastic housing310utilized in the device to provide the entrance and exit apertures for the LED and the sensor to the optical element106. Other housings, for example a housing with a roughened surface which might allow backlighting features, can also be used in the device.

It should be noted that ensuring that the main beam from the LED arrives at the “pupil” is not necessarily optimal. The lens apex of optical devices204can be off-set from the centre of the stop and the sensor off-set from the center of the lens to ameliorate the effects of the variation in object distance (e.g. tombstone distortion). The centre of the image does not necessarily need to coincide with the main beam from the LED.

A further embodiment (not shown) may be implemented using a double bounce orientation. The double bounce is used to bring the mousing surface closer to being parallel to the imaging surface thus improving the resolution and reducing the distortion of the image on which mousing is preformed. To control the illumination intensity and directional distribution at the mousing surface (as can be seen inFIG. 2) the optical device204can be tilted and the individual elements in the “fly eye” structure can be individually tilted. This arrangement can be realized in any plastic material at any wavelength where the silicon CMOS sensor is sensitive.

Referring now toFIG. 4, a further embodiment of an optical navigation device module400will now be described. As with the previous embodiment the optical navigation device module includes an LED illumination source202, a sensor206; TIR fold surfaces300and302respectively; optical elements204and208, and a mousing surface112. The mousing surface is designed in a general undulating cross section. This shape is more clearly illustrated inFIG. 5, which shows an isomeric view of the undulating mousing surface.FIG. 4shows the undulating surface that includes a gentle protrusion402,404formed at the ideal mousing point on the device. Using this form for the mousing surface ensures that un-used radiation is scattered away from the stop of optical element208. Use of the undulating surface also provides a point where the pressure between the user's finger, or other pointer, and the mouse is maximized to give best F-TIR contrast ratio, and further provides the user with a point of reference on the mousing surface. The undulation can be used to hide a flat for the mousing surface within a smooth continuous and rising shape, if required.

The undulating surface also lends itself to the use of a visibly clear plastic where the light scattered away from the objective lens aperture can be reflected off the lower surface of the optics to output a visible signal, which may be used to indicate status of a mobile or computer device.

Referring now toFIG. 6, the exploded view of the optical navigation device module demonstrates the available space which is enabled by the particular design of optics and function.FIG. 6shows the base plate102, the LED108, the sensor110, the PMMA optical element106and a housing114. In addition a space116is clearly visible.

The optical navigation device is suitable for use in any device which makes use of a navigation device. For example, the optical navigation device may be used on a mobile computer, phone, a remote controller or any other appropriate device.

FIG. 8shows a device800from a bird's eye view, which could be for example a computer device or mobile phone, which comprises the optical navigation device module100. The device800is shown in a simplified way. The device800could also comprise for example a display or a keypad not shown inFIG. 8. The radiation source202and the sensor206are on a level below the F-TIR mousing surface112of the optical navigation device module100.

On the mousing surface112of the optical navigation device module100, a rectangular imaged area802is shown. The imaged area802demonstrates an area stretched in one particular direction in which movements of a feature are detected. The direction in which the imaged area802is stretched corresponds with the direction of a longitudinal axis804of the imaged area802. The longitudinal axis804of the imaged area802is parallel to an axis806connecting the radiation source202and the sensor206and the imaged area802is located at the centre of the F-TIR mousing surface112. The imaged area802is stretched in one direction because the F-TIR surface is at an angle to the plane of the sensor206. This can be explained for example with the reflection of radiation which is sent through a prism formed like a trapezoid. This radiation is reflected from the longer basis side of the prism at a larger area along this basis side than in a direction perpendicular to the basis side in the plane of the basis side. An image on the sensor206resulting from movements of a feature on the mousing surface112is compressed along the longitudinal axis804of the imaged area802because the image is focused on the sensor206, which is for example square shaped. This leads to a lower resolution along the direction in which the imaged area802is stretched because a lower number of pixels are detected per imaged period. So the sensitivity of the imaged area802is increased along the direction in which it is stretched.

Because of the angle in which the radiation is reflected from the F-TIR surface, astigmatism occurs, i.e. radiation from the sagittal plane does not focus at the same point than radiation from the tangential plane. This leads to the effect that an image is sharp along a first direction but blurred along a second direction when the best focus point is set for a spatial frequency in the first direction, or blurred along the first direction and sharp along the second direction when the best focus point is set for a spatial frequency in the second direction. The effects of the astigmatism can be reduced by focusing the radiation reflected from the mousing surface112at the circle of least confusion, i.e. at an intermediate focal length where diagonal spatial frequencies appear clear. As the image on the sensor206is compressed along the longitudinal axis804(second direction), a better contrast for the corresponding spatial frequencies in the first direction can equilibrate the sensitivity between movement along the first and second direction. This can be obtained by focusing the radiation from the mousing surface112between the circle of least confusion and the position where spatial frequencies in the first direction appear sharper.

The longitudinal axis804of the imaged area802is perpendicular to a longitudinal axis808of the device800and parallel to an axis810perpendicular to the longitudinal axis808on the F-TIR mousing surface112. When the device800is operated by a user directly in front of the device800and the optical navigation device module100is used with a user's finger812or a pointer not shown inFIG. 8, it is advantageous when the imaged area802is stretched in a direction which corresponds to a sideways or horizontal movement of a user's finger812or a pointer instead of a direction which corresponds to an up and down or vertical movement. Since the elasticity of the finger812or the pointer is considered to be higher in moving sideways than moving up and down, the delay before the sensor206detects an image when the movement on the mousing surface112is sideways can be compensated by orientating the stretched image area802in the direction in which a sideways movement of a user's finger or pointer is considered to occur during the intended use of the device800. This is shown inFIG. 8. In case of using a finger, another advantage results from the fact that lines of a fingerprint are nearly horizontal at the top. When the finger812is moved sideways, meaning along the nearly horizontal lines on the finger, the chance that these movements are detected is the higher the larger the area in which the movements are detected is. So, when the imaged area802is stretched in the direction as shown inFIG. 8, a larger area is provided in the direction of sideways movement of the finger812.

An angle included by the longitudinal axis804of the imaged area802and the longitudinal axis808of the device800does not have to be exactly 90° as shown inFIG. 8. The angle can be in a range between 80° and 100° to provide the above mentioned advantages. Although this aspect has been described as being based on the angle between imaged area axis and axis of phone/computer device800, it has to be noted that it is mainly the axis of a user's finger812when using the device800that is critical rather than that of the device800in which the module100is housed. Furthermore, it has to be noted that the long axis of the relevant device800depends on the device, i.e. a camera is usually “landscape” (i.e. wider than taller) but a remote control is usually “portrait” (i.e. taller than wider).

It will be appreciated that this invention may be varied in many different ways and still remain within the intended scope and spirit of the invention.