Unobtrusive eye mounted display

An unobtrusive augmented reality (AR) system can be used to assist the wearer in every day interactions by projecting information from the contact lens display onto the retina of the wearer's eye. The unobtrusive augmented reality system includes a necklace and a contact lens display that are unobtrusive to the wearer and the wearer's surrounding environment. The necklace of the unobtrusive augmented reality system generates power and data for the contact lens displays. The necklace and contact lens display include conductive coils inductively coupled by a magnetic field. The inductive coupling allows data and power generated by the necklace to be transferred to the contact lens display. A projector in the contact lens display projects images generated from the data onto the retina of the wearers eye.

BACKGROUND

1. Technical Field

This disclosure relates generally to an augmented reality system, and more particularly, to an unobtrusive eye mounted augmented reality system.

2. Description of Related Art

Augmented reality (AR) adds computer-generated information to a person's view of the world around them. A common augmented reality platform is a special pair of glasses that displays information while still allowing one to see through them. Unfortunately, current AR glasses are significantly larger and heavier than regular glasses. They make a person wearing them look awkward.

What are needed are augmented reality systems that are so lightweight and easy to use that people want to use them all the time.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

An unobtrusive augmented reality system can be used to assist a wearer in every day interactions by projecting information from a contact lens display onto the retina of the wearer's eye. That is, the augmented reality system is comfortable for a person to wear all day long, is difficult for others to see, and is wearable as part of a daily wardrobe. The unobtrusive augmented reality system includes a necklace and a contact lens display that are unobtrusive to the wearer and the wearer's surrounding environment. For example, the augmented reality system can recognize the speech of a person talking using electronics embedded in the necklace. Further, the AR system can project the text of the speech onto the eye of the wearer using the contact lens display.

In one configuration, the necklace of the unobtrusive augmented reality system generates power and data for the contact lens displays. The necklace includes a conductive coil which generates a magnetic field. The contact lens display includes a conductive coil inductively coupled to the conductive coil of the necklace via the magnetic field. The inductive coupling between the necklace and the contact lens allows data and power generated by the necklace to be transmitted (i.e., delivered) to the contact lens display. The contact lens display receives the data and power from the inductively coupled necklace. In other configurations, data and power may be delivered from the necklace to the contact lens display using various other wireless transmission methods.

A projector in the contact lens display projects images generated from the data onto the retina of the wearers eye. In one example, the contact lens display can include a tiny projector—for example a “femtoprojector” as described by Deering in U.S. Pat. No. 8,786,675, “Systems using eye mounted displays”. The contact lens may act as a conventional, vision-correcting lens at the same time that it supports a femtoprojector, so there is no need to wear glasses. Advanced systems include multiple femtoprojectors that cover a wide field of view and project images at different resolutions corresponding to the natural resolution of the different parts of the retina at which they are aimed.

Whatever the configuration of the necklace and contact lens display, it is substantially unnoticeable to others. The necklace may include hardware elements such as a rechargeable battery, a radio-frequency modulator, a data modem, a wireless network connection, sensors, a microprocessor and memory, as examples. Further, the system may optionally include wireless or wired earphones that may couple to elements of the necklace. An unobtrusive augmented reality system including a contact lens display and necklace may therefore replace the display of a smartphone. An advanced system may replace all of the capabilities of a smartphone such as voice and text communications, photography, music and video playback, etc.

The unobtrusive augmented reality system described herein provides features and advantages long promised by AR enthusiasts in a form that is natural and does not interfere with daily life.

FIG. 1Ashows a person wearing an augmented reality system100including a hidden necklace110. The person is wearing contact lens displays120in her eyes, but the displays are as hard to notice as regular contact lenses. Also hard to notice is the necklace110hidden under her shirt. Although the person can see computer generated information superimposed on her normal view, other people around her can't tell.

FIG. 1Bshows a person wearing an augmented reality100system including a visible necklace110. Even though the necklace110is in plain sight, it may be designed to look like ordinary jewelry and therefore attracts no special notice. Whether the necklace is hidden (as inFIG. 1A) or disguised (as inFIG. 1B), it does not alter one's impression of the person wearing it. Her appearance other than the addition of the necklace110is not affected by the AR system.

FIG. 1Cshows another example of person wearing an augmented reality system100including a visible necklace110. In this example, the augmented reality system includes an electronic device130wirelessly coupled to the necklace110to facilitate displaying images, reacting to speech, receiving messages, etc. The electronic device130provides added computational power to increase the functionality of the augmented reality system100. In one embodiment, the electronic device130is a mobile computing device executing an application that allows the electronic device130to wirelessly couple to and interact with the necklace110.

FIG. 1Dshows an additional example of a person wearing an augmented reality system100including a visible necklace110. In this example, various hardware elements140for controlling the augmented reality system are distributed throughout the necklace100. In the examples ofFIGS. 1A-1Cthe hardware elements140are generally localized to a pendant of the necklace. Generally, the pendant may be an ornamental object hanging from the necklace110(as seen inFIG. 1A-1C) that is configured to enclose and conceal the hardware elements of the augmented reality system. By contrast, distributing the electronics about the circumference of the necklace allows for a broader range of necklace designs (e.g., without a pendant) suitable to a variety of aesthetic tastes.

Furthermore, the AR system ofFIGS. 1A-1Ddoes not disturb the wearer. The contact lens displays120may also function as regular contact lenses providing refractive eyesight correction if required. The necklace110is lightweight and may not need to be held in one's hand like a cell phone or tablet. The electronic device130is similar in size and shape to the electronic devices already used by persons in modern computing environments. When the contact lens displays are not showing images, the wearer is hardly conscious of the AR system. When the system is displaying images, reacting to speech or receiving messages, it provides functions like that of a smartphone but in a more natural way.

While the unobtrusive augmented reality system is illustrated with a necklace110, in other embodiments the functions of the necklace110described herein can be integrated in other types of wearable devices. As an example, the functionality of the necklace can be embedded in a neck tie, a scarf, a belt, the brim of a hat, the collar of a shirt, the hood of a jacket, a headband, earphones, etc. More generally, the functionality of the necklace can be incorporated into any wearable object that is substantially round or may form a loop.

FIG. 2Ashows a necklace110of an unobtrusive augmented reality system. In the illustrated embodiment, the necklace110includes a coil210of conductive material such as an insulated wire and an electronic module220. The module220contains the various components for controlling the augmented reality system100. In some configurations the module is within a pendant of the necklace. In other configurations, the necklace110does not include a module220and the hardware elements140are distributed about the perimeter230of the necklace as inFIG. 1D. The perimeter230of the necklace is preferably between 45 cm and 75 cm and can be less than 150 cm. When the necklace110has a curved shape, the perimeter230may be the circumference of the necklace110. Generally, the perimeter of the coils allow for the necklace to be worn comfortably on the human body. Additionally, the number of conductive turns in necklace coil210is chosen considering factors such as power requirements of contact lens displays120, maximum permitted specific absorption rate of radio frequency radiation, operating frequency, etc. For example, when a 60 cm necklace110is designed to couple power to a contact lens display120at 13.56 MHz, the necklace coil may have exactly one turn. More generally, any unlicensed frequency band can be used to couple the necklace to the contact lens display. For example, the system can use an industrial, scientific, and medical radio band (ISM).

Furthermore, conductors in the coil210may extend around the circumference230of the necklace110for one, two, three, or more turns. These turns may be connected or disconnected with a plug240and socket242when putting the necklace110on or taking it off. Connecting the plug240to the socket242allows data and power to be transmitted between the necklace110and contact lens display120, and disconnecting the plug240from the socket242prevents data and power from being transmitted between the necklace110and contact lens display120. Generally, the coil210is configured to be worn around a user's neck as a necklace110when the plug240and socket242are connected. In some configurations, the plug240and socket242can be configured as a ‘quick-release’ connector. The quick-release connector can allow a user to rapidly break the connection between the plug240and socket242and cease data and power transmission from the necklace110to the contact lens display120. In some configurations, the necklace110may function as part of the AR system100without a plug240and socket242. In these cases, the necklace can include other methods of regulating data and power transmission from the necklace to the contact lens (e.g., a switch, a coupled controller, etc.).

InFIG. 2A, the socket242is illustrated as being part of the module220, but a plug240and socket242may be located anywhere along the circumference230of the necklace110. In alternative configurations, the plug and socket can be any two complementary fasteners that can be removably connected from each other (e.g., coupled and decoupled) and allow for the physical and electrical connection and disconnection of the coil210. For example the fasteners can be wire connectors, banana plugs, multi-pin wire connectors, etc. In effect, coupling the plug240to the socket242(i.e. a first fastener to a second fastener) completes the coil210and enables the coil210to transmit wireless data and power. Conversely decoupling the plug240and socket242(i.e. a first fastener from the second fastener) breaks the coil210and disables the coil210from transmitting wireless data and power.

In some configurations, the complementary first fastener and second fastener can be additionally configured into a complementary connectors for opposing ends of the necklace110. For example, the connectors can be a clasp, a magnetic clasp, a slide lock clasp, a barrel clasp, etc. In other configurations, the complementary connectors may be configured to couple in specific orientations that ensure conduction through the conductive coil when coupled. Whatever their configuration, the first connector and the second connector are configured to couple and decouple opposing ends of the necklace110.

FIG. 2Bshows a necklace of the augmented reality system such as the necklace ofFIGS. 1A-1C. In the illustrated embodiment, the necklace includes a module220that may have an exterior appearance of jewelry or a fashion accessory. However, the module220may contain additional hardware elements140such as: a power source, a battery, etc.; a driver to drive a radio-frequency current onto the necklace coil; a direct current (DC) power supply278to drive a direct current (DC) power onto the necklace coil; a protection circuit configured to shut down hardware elements140(e.g., amplifier270, data processor250, etc.) of the necklace110when the necklace coil210is decoupled; a data modem (or modulator) to encode data on the radio-frequency signal; sensors such as microphones, cameras, inertial sensors, GPS receivers, barometric pressure sensors, etc.; a cellular radio; a Wi-Fi radio; a Bluetooth radio; a capacitance tuning circuit configured to maintain the necklace at resonance (i.e., as the body moves) and sustain efficient power transfer; a graphics processing unit; and/or, a microprocessor and memory. In some configurations the DC power supply278provides DC power while the amplifier270provides AC power. In other configurations, the hardware elements140included in the module220may be distributed about the circumference of the necklace as inFIG. 1D.

When the hardware elements140produce a radio-frequency current in the necklace coil210, power may be coupled into a coil embedded in a contact lens display120. Each coil may be made resonant at a desired operating frequency with capacitive and/or inductive matching circuits. Data may be transmitted to the contact lens display120by modulating the radio-frequency current in the necklace coil210. Amplitude, frequency and phase modulation are examples of modulation schemes that may be employed. For example in frequency shift keying, a pair of discrete frequencies are used to indicate logical “0” and logical “1”. In some configurations, the system100can include more than one antenna with each antenna configured to receive either power or data at dissimilar frequencies.

The hardware elements140may include a microphone (or multiple microphones) to sense voices and other sounds. The wearer of an unobtrusive augmented reality system100may control the system by speaking to it, for example. The system100may also include hardware elements such as a speaker and/or wireless connection to earphones. The system100may be controlled via a touch sensor in the necklace or via gestures detected by hardware elements140including radar (e.g. 60 GHz radar), an outward facing camera, ultrasonic and/or thermal sensors.

Additional hardware elements such as inertial (acceleration and rotation rate) sensors, coupled with a barometric pressure sensor and a GPS receiver may provide position and velocity data to the system100. Further, a cellular radio and/or Wi-Fi radio hardware element provide connections to voice and/or data networks. Finally, a processor, graphics processing unit and memory run applications and store data. The hardware elements are configured to transmit data and images that display on a contact lens display120in a wearer's eyes.

When the AR system100is connected to an electronic device130as inFIG. 1C, any of the sensors, processors and other components described herein may be located in the electronic device130. That is, in various configurations, any capabilities of the necklace110and contact lens displays120may be incorporated into the electronic device130. Alternatively, the hardware elements140of the necklace110may connect to an electronic device130wirelessly or it may connect physically via a plug-and-socket connector or other type of connector.

FIG. 2Cshows a circuit diagram for the hardware elements140in a necklace110, i.e. the necklace110ofFIGS. 2A-2B, of an unobtrusive augmented reality system100. The necklace includes a data processor250that receives sensor input signals252from sensors254(e.g. microphone, camera, etc.) and input data256A from a communication interface circuit258. In various embodiments, the necklace can include multiple data processors250configured to accomplish various functions of the unobtrusive AR system100in more complex data processing architectures.

The communication interface circuit258communicates data between the necklace110and an electronic device130(e.g., a smartphone or tablet computer). That is, the necklace110is configured to send output data256B to, and receive input data256A from, the electronic device130. The electronic device130facilitates processing data that is to be displayed via the contact lens display120. The data processor250processes the received input signals252and input data256, and generates data260for display using the contact lens display120. The data processor250outputs the data260to the modulation circuit262.

The modulation circuit262receives data260from the coupled data processor250and clock signals264from the clock generator circuit266. The modulation circuit262modulates the clock signal264using the data260and generates a modulated signal268. The modulation circuit262can use amplitude, frequency and phase modulation schemes to generate the modulated signal268. The modulation circuit262outputs the modulated signal268to the amplifier270.

The amplifier270receives the modulated signal268from the coupled modulation circuit and amplifies the modulated signal to generate an amplified modulated signal272. Amplifying the signal increases the power of the signal. The amplifier270can amplify the signal linearly or non-linearly and can amplify the voltage, current, or spectral power of the modulated signal268. The amplifier270outputs the amplified modulated signal272to the conductive coil210.

The conductive coil210receives the amplified modulated signal272from the coupled amplifier270and converts the signal272into a magnetic field. The magnetic field is provided to the contact lens through inductive coupling, and may provide both wireless data transfer and wireless power to the contact lens. The number of turns in the conductive coil210can be selected to influence performance (e.g., operating frequency, coupling efficiency, etc.) of the hardware elements140in the necklace110. Additionally, the conductive coil210can receive signals from the contact lens display120and transmit those signals to a receiver.

Generally, the necklace110and the contact lens display120transmit data and power at a frequency which allows for easily maintained inductive coupling. Similarly, the necklace110and contact lens display120are configured such inductive coupling is easily maintained at typical separations between a necklace and a contact lens. In other configurations, the power and data may be transmitted from the necklace110to the contact lens display120at different frequencies or by using different methods.

The receiver274receives a signal from the conductive coil210and converts the received signal into received data276. In one example, converting a received signal into received data involves determining changes in the impedance of the conductive coil210and converting the impedance changes into received data276.

Effectively, the hardware elements140of the necklace110act as a primary circuit of an inductive wireless transfer system. The primary circuit may resonate (or, more generally, operate) at a first frequency and can wirelessly transfer power and data to a secondary circuit magnetically coupled to the primary circuit and also resonating at the first frequency. Additionally, the primary circuit can receive data from the secondary circuit in a similar manner. Generally, the contact lens display120acts as the secondary circuit.

Continuing,FIG. 3Ashows a contact lens display120mounted on a person's eye. The contact lens display120includes a femtoprojector310mounted in a contact lens320, and a conductive coil330near the edge of the contact lens320for receiving power and data wirelessly from the necklace110as inFIGS. 2A-2C. The femtoprojector310may include electronics for recovering power from the conductive coil330in the contact lens320, processing data transmitted to the contact lens320, and driving a light source inside the femtoprojector310. The femtoprojector310produces images on a wearer's retina. The images are projected with a spatial resolution that may substantially match (or, in some cases, may not match) the resolution of retinal midget ganglion cells in the area of the retina to which the femtoprojector310is aimed. The natural resolution of a retina is greatest at the fovea and decreases according to the functional form−log(tan(θ/2)) where θ is the visual eccentricity.

FIG. 3Bshows a cross sectional view of a contact lens display120containing a femtoprojector310in a contact lens320.FIG. 3Bshows an embodiment using a scleral contact lens but the contact lens does not have to be scleral. The contact lens320is separated from the cornea of the user's eye340by a tear layer342. The contact lens display120has an outer surface facing away from the eye340and an inner surface contacting the tear layer342. Generally, the femtoprojector310is positioned between the front surface and the back surface and projects images onto the wearer's retina346. The contact lens320preferably has a thickness that is less than two mm, and the femtoprojector310preferably fits in a 2 mm by 2 mm by 2 mm volume. The contact lens320is comfortable to wear and maintains eye health by permitting oxygen to reach the user's eye340. In some configurations the contact lens320is a scleral contact lens, but in other configurations the contact lens is a soft contact lens.

FIG. 3Cshows the contact lens display120ofFIG. 3Ain more detail.FIG. 3Cshows a top view of a contact lens display120with multiple femtoprojectors310A-C in a contact lens320. The conductive coil330in the contact lens320may have between about between 1 and 20 turns arranged in a spiral. In other configurations, the conductive coil can be arranged in a cylindrical coil or any other looped shape. It is connected to the femtoprojector and other electronics via embedded conductors332. The femtoprojector310, conductive coil330and electronics are enclosed in lens material such that the lens feels to a wearer like a conventional contact lens. The contact lens320is between about 6 mm and about 25 mm in diameter and preferably between about 8 mm and about 18 mm in diameter. In other configurations, the contact lens320may be any other curved shape (e.g., an oval).

The ratio of the contact lens320diameter to femtoprojector310lateral size is roughly 25:1 for the largest femtoprojector. This ratio is normally between about 15:1 and 30:1, but may be as small as 5:1 or as large as 50:1.FIG. 3Cshows three femtoprojectors310A-C in the contact lens320, but many femtoprojectors, or only one, may be mounted in such a lens320. Eye-mounted displays120with as many as 49 femtoprojectors in a contact lens320have been proposed. If there is only one femtoprojector310in a contact lens320, it need not be in the center of the lens.

The femtoprojectors310inFIG. 3Care also shown as different sizes. The entire display, made up of all the femtoprojectors, may be a variable resolution display that generates the resolution appropriate for each region of the eye, vastly reducing the total number of individual “display pixels” required compared to displays of equal resolution and field of view that are not eye-mounted. For example, a 400,000 pixel eye-mounted display using variable resolution can cover the same field of view as a fixed external display containing tens of millions of discrete pixels.

InFIG. 3C, the contact lens320is roughly divided by the dashed circle into an optical zone322and a non-optical zone324. Components in the optical zone322may be in the optical path of the eye, depending on how far open the iris is. Components in the non-optical zone324fall outside the aperture of the eye. Accordingly, light-emitting optical elements are generally positioned in the optical zone and non-light-emitting optical elements are positioned in the non-optical zone. For example, femtoprojectors310are within the optical zone322. Additionally, the contact lens may also contain other components positioned in the non-optical zone322for data processing, data transmission, environment sensing, and power and/or positioning. These components are represented inFIG. 3Cas an integrated circuit (IC)312coupled to the femtoprojectors310and conductive coil330. In some embodiments, any or all of the functionality of the IC312may be included in the femtoprojectors310.

As a general example, data transmission components may include antennae or optical/infrared photodetectors, ultrasound detectors, data storage and buffering, controls, and possibly also on-lens processing. Power components may include coils for power transmission and batteries or capacitors for power storage. Environment sensing components may include accelerometers, cameras, microphones, etc. Positioning components on the contact lens320may include accelerometers, magnetometers, gyroscopes, cameras or other components capable of giving positional information. Further the positioning components can include fiducial or other structures used for eye tracking and head tracking that operate in conjunction with components external the contact lens320. Data processing components can include a microprocessor or other data processing elements.

There are many ways in which this functionality can be configured with an eye-mounted display(s) to create embodiments of eye-mounted display systems. Portions of these subsystems may be external to the user, while other portions may be worn by the user in the form of a headpiece or glasses. Components may also be worn on a belt, armband, wrist piece, necklace or other types of packs.

FIG. 3Calso shows a secondary antenna314coupled to the IC312. The secondary antenna314can be any antenna that allows components of the contact lens320to receive data or power in a method other than inductive coupling to the necklace110. For example, the secondary antenna314can be configured to receive data from the electronic device130via Bluetooth.

FIG. 3Dshows a circuit diagram for the hardware elements in a contact lens display120(e.g., the contact lens display ofFIGS. 3A-3C) of an unobtrusive augmented reality system100. The contact lens display120includes a conductive coil330. The number of turns in the conductive coil330can be selected to influence performance of the contact lens display120. The conductive coil330is inductively coupled to the conductive coil210of the necklace110and receives a portion of the magnetic field generated from the conductive coil210. The magnetic field can transfer both wireless power and wireless data that may be received by the conductive coil330. The conductive coil330converts this magnetic field into electric current.

The receiver350receives a signal from the conductive coil330and demodulates it into display data352(or any other type of data). The display data352is transmitted to the projection system354.

Additionally, the conductive coil330is coupled to a power recovery circuit356. The power recovery circuit356recovers power from the conductive coil330and generates a supply voltage360from the recovered power. The inductive coupling between the necklace110and the contact lens display120allows power to be transferred via an induced magnetic field between the conductive coil210of the necklace110and the conductive coil330of the contact lens display120. The power recovery circuit356receives this power and generates a supply voltage360that is used to power the projection system354and other electronics and sensors of the contact lens320. In some cases, the functionality of the power recovery circuit356can be included in the receiver350. In one embodiment, the contact lens display120can include a rectifier circuit that rectifies the signal received from the necklace110. In this configuration, the power recovery circuit356and the receiver350can receive the rectified signal. In one embodiment, the power recovery circuit356is a power converter that converts input power from the conductive coil330into output power.

The projection system354receives display data352from the receiver350and the supply voltage360from the power recovery circuit356and displays images onto the eye of the user via the femtoprojector(s)310. In some cases, the projection system354additionally includes data processing elements that process the display data352such that it can be displayed as images by the femtoprojector310.

Additionally, the projection system354generates feedback data362describing operation of the projection system354. Further, in some example configurations, sensors included in the contact lens320generate feedback data362describing conditions sensed by the sensors for transmission to the necklace110. The feedback data362is transmitted to the transmitter364. The transmitter364receives feedback data362from the projection system354and performs impedance modulation across the conductive coil330based on the feedback data362. Accordingly, the transmitter364changes the impedance across the conductive coil330such that the feedback data362can be detected by the necklace110via detection of the impedance changes.

In one embodiment, the transmitter364functions as a backscatter circuit. That is, the transmitter364modulates the impedance across the conductive coil by shorting the conductive coil330. Shorting the conductive coil changes the backscatter of the contact lens display120(i.e., reflection of waves transmitted to the contact lens display120by the necklace110). The modulated backscatter of the contact lens display120can, subsequently, be received by the inductively coupled necklace110and affect the voltage seen across the coil210of the necklace110. The receiver circuit274of the necklace110then recovers the feedback data from the voltage across the conductive coil210.

Effectively, the hardware elements of the contact lens display120act as a secondary circuit of an inductive wireless transfer system. The secondary circuit resonates at the frequency of the primary circuit and can wirelessly receive power and data from a magnetically coupled primary circuit. Additionally, the secondary circuit can transmit data to the primary circuit. Generally, the necklace110acts as the primary circuit while the contact lens display acts120as the secondary circuit.

Applications of an unobtrusive augmented reality system include all applications contemplated for eyeglasses-type AR.FIGS. 4A-4Cillustrate applications that are suited for deaf people, people travelling in foreign countries, or people who have forgotten an interlocutor's name.

FIG. 4Ashows a person speaking to another person who is wearing an augmented reality system. The man's voice is detected by a microphone410of the necklace110(or by the electronic device130) of the woman's unobtrusive augmented reality system. That is, microphone410(or an array of microphones) receives sound from the man's voice and converts the sound into an audio frequency electrical signal (e.g., input signal252) of the man's voice. The woman may be deaf, or she may not understand the language spoken by the man, or she may have forgotten his name. In the first two cases, a processor250in the necklace module recognizes speech in the audio signal of the man's voice and transmits data to the contact lens display120that causes the contact lens display120to display what he is saying as text in the woman's field of view. The text may be in the original language, or translated into another language that the woman understands. In speaker identification mode, the processor250records a sample of the man's voice and compares it against a database of voice samples to determine what his name is. Thus, the necklace determines the source of the audio signal and transmits data to the contact lens display120that causes the contact lens display120to display text identifying the source of the audio signal in one or more images displayed by the contact lens display120. The database and associated voice matching operations may be performed by a server in the cloud.

FIG. 4Bshows a series of views of what the woman sees. As the man speaks, and as time progresses from t1to t2to t3, the woman sees “LET'S”, “HAVE”, and “LUNCH”, superimposed on the man's face or wherever she happens to be looking. (In the figure the words are shown in different positions near the man's face to indicate that the woman's gaze shifts.) In this way, she can see what he is saying while looking directly at him, just as she would in normal conversation. From the man's point of view, the woman understands what he is saying, without any visible assistance despite hearing loss or not understanding his language.

The text is presented to the woman in her field of vision in a low duty-cycle, rapid serial presentation. She does not need to scan laterally to read a sentence. Many people can understand text presented in this way at a rate of 10 words per second or more. When the man stops talking the display becomes clear, as if it were no longer there. When used for language translation the effect is similar to a subtitles on a movie, which many people are used to and find acceptable or normal. The text may be color coded or presented in different fonts to indicate different people speaking. In speaker identification mode the man's name is presented in the woman's field of view.

FIG. 4Cshows an alternate implementation of series of views of what the woman sees. As the man speaks, and as time progresses from t1to t2to t3, the woman sees “LET'S HAVE LUNCH”, “TOMORROW”, and “11:30 AM?”, superimposed on the man's face or wherever she happens to be looking. In this example, groups of words are presented serially rather than single words at a time. Many people can still understand normal speech patterns presented in this way.

In an implementation similar toFIGS. 4A-4C, the unobtrusive AR system100may be configured to interpret manual communication and display text corresponding to the manual communication to the wearer of the contact lens display. For example, images of a person's manual communication (e.g., American Sign Language) are captured by a camera of the necklace110(or by the electronic device130) of a person wearing the augmented reality system100. The processor250receives images of the manual communication and interprets the manual communication and converts it into data describing the text represented by the manual communication using a machine learning model. The system100transmits the data to the contact lens display120which causes the contact lens display120to display text of what is being communicated with the manual communication in the wearer's field of view.

An augmented reality system based on a contact lens display and a necklace as described herein is unobtrusive to others and also to its own wearer. It can be worn all day and replaces many functions of smartphones and tablet computers and/or their conventional displays.

Although the detailed description contains many specifics, these should not be construed as limiting the scope of the invention but merely as illustrating different examples and aspects of the invention. It should be appreciated that the scope of the invention includes other embodiments not discussed in detail above. Various other modifications, changes and variations which will be apparent to those skilled in the art may be made in the arrangement, operation and details of the method and apparatus of the present invention disclosed herein without departing from the spirit and scope of the invention as defined in the appended claims. Therefore, the scope of the invention should be determined by the appended claims and their legal equivalents.

In the claims, reference to an element in the singular is not intended to mean “one and only one” unless explicitly stated, but rather is meant to mean “one or more.” In addition, it is not necessary for a device or method to address every problem that is solvable by different embodiments of the invention in order to be encompassed by the claims.

FIGS. 2C and 3Dmay comprise multiple elements. An element may comprise any physical or logical structure arranged to perform certain operations. Each element may be implemented as hardware, software, or any combination thereof, as desired for a given set of design parameters or performance constraints. Examples of hardware elements may include devices, components, processors, microprocessors, circuits, circuit elements (e.g., transistors, resistors, capacitors, inductors, and so forth), integrated circuits, application specific integrated circuits (ASIC), programmable logic devices (PLD), digital signal processors (DSP), field programmable gate array (FPGA), memory units, logic gates, registers, semiconductor device, chips, microchips, chip sets, and so forth. Examples of software may include any software components, programs, applications, computer programs, application programs, system programs, machine programs, operating system software, middleware, firmware, software modules, routines, subroutines, functions, methods, interfaces, software interfaces, application program interfaces (API), instruction sets, computing code, computer code, code segments, computer code segments, words, values, symbols, or any combination thereof. Although the unobtrusive augmented reality system as shown in the figures has a limited number of elements in a certain topology, it may be appreciated that the necklace110ofFIG. 2Cand the contact lens display ofFIG. 2D, may include more or fewer elements in alternate topologies as desired for a given implementation. The embodiments are not limited in this context.

Depending on the form of the elements, the “coupling” between elements may also take different forms. Dedicated circuitry can be coupled to each other by hardwiring or by accessing a common register or memory location, for example. Software “coupling” can occur by any number of ways to pass information between software components (or between software and hardware, if that is the case). The term “coupling” is meant to include all of these and is not meant to be limited to a hardwired permanent connection between two components. In addition, there may be intervening elements. For example, when two elements are described as being coupled to each other, this does not imply that the elements are directly coupled to each other nor does it preclude the use of other elements between the two.