# Patent

## Title
Input system

## Abstract

Apparatus, systems and methods facilitating contact lenses that detect fatigue or emotional state of a wearer of the contact lenses are provided. In some aspects, a contact lens includes: a substrate; one or more sensors disposed on or within the substrate, wherein the one or more sensors senses fatigue and/or an emotional state of a wearer of the contact lens; and an antenna disposed on or within the substrate, that communicates information sensed by the one or more sensors. In various aspects, systems can include the contact lens, a reader that can process the information sensed and an alarm generation component that can generate an alarm based on the determined fatigue and/or emotional state of the wearer of the contact lens.

## Background
TECHNICAL FIELD
This disclosure generally relates to contact lenses that facilitate detection of fatigue and/or emotional states of wearers of the contact lenses.
BACKGROUND
There are many applications and/or environments in which it is useful to determine fatigue or an emotional state of a person. These environments include, but are not limited to, during operation of a motorized vehicle or aircraft, during operation of machinery, during sleep studies and the like. Accordingly, systems, apparatus and/or methods that facilitate determination of fatigue and/or emotional state of a person are desired.
SUMMARY
In some aspects, a contact lens can include: a substrate; and a circuit. The circuit can include: one or more sensors disposed on or within the substrate, wherein the one or more sensors sense at least one of fatigue or an emotional state of a wearer of the contact lens; and an antenna disposed on or within the substrate, that communicates information sensed by the one or more sensors. In various aspects, alarms can be generated and/or notification of an alarm (or alarm condition) can be transmitted. In some aspects, a signal can be transmitted to cause a particular device being operated by the wearer of the contact lens to perform in a certain manner (e.g., cease operation, fail to commence operation).
In some aspects, a system can include: a contact lens that senses fatigue of a wearer of the contact lens; and a reader that receives a signal from the contact lens, the signal including information indicative of the fatigue of the wearer of the contact lens.
In some aspects, a method can include: sensing, using a contact lens, fatigue of a wearer of the contact lens, wherein the sensing is performed via one or more sensors disposed on or within the contact lens.



BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 is an illustration of a block diagram of an exemplary non-limiting system that facilitates detection of fatigue and/or emotional states of wearers of contact lenses.
FIG. 2 is an illustration of a block diagram of an exemplary non-limiting contact lens that facilitates detection of fatigue and/or emotional states of wearers of the contact lens.
FIG. 3 is an illustration of a block diagram of an exemplary non-limiting system that facilitates detection of fatigue and/or emotional states of wearers of contact lenses.
FIGS. 4, 5, 6, 7 and 8 are illustrations of exemplary flow diagrams of methods that facilitate detection of fatigue and/or emotional states of wearers of contact lenses.
FIG. 9 is an illustration of a schematic diagram of an exemplary networked or distributed computing environment for implementing one or more aspects described herein.
FIG. 10 is an illustration of a schematic diagram of an exemplary computing environment for implementing one or more aspects described herein.



DETAILED DESCRIPTION
Various aspects are now described with reference to the drawings, wherein like reference numerals are used to refer to like elements throughout. In the following description, for purposes of explanation, numerous specific details are set forth in order to provide a more thorough understanding of one or more aspects. It is be evident, however, that such aspects can be practiced without these specific details. In other instances, structures and devices are shown in block diagram form in order to facilitate describing one or more aspects.
As used in this application, the terms “component,” “component,” “system,” and the like are intended to refer to a computer-related entity, either hardware, software, firmware, a combination of hardware and software, software and/or software in execution. For example, a component can be, but is not limited to being, a process running on a processor, a processor, an object, an executable, a thread of execution, a program, and/or a computer. By way of illustration, both an application running on a computing device and/or the computing device can be a component. One or more components can reside within a process and/or thread of execution and a component can be localized on one computer and/or distributed between two or more computers. In addition, these components can execute from various computer-readable storage media having various data structures stored thereon. The components can communicate by way of local and/or remote processes such as in accordance with a signal having one or more data packets (e.g., data from one component interacting with another component in a local system, distributed system, and/or across a network such as the Internet with other systems by way of the signal).
The word “exemplary” is used herein to mean serving as an example, instance, or illustration. For the avoidance of doubt, the subject matter disclosed herein is not limited by such examples. In addition, any aspect or design described in this disclosure as “exemplary” is not necessarily to be construed as preferred or advantageous over other aspects or designs, nor is it meant to preclude equivalent exemplary structures and techniques known to those of ordinary skill in the art. Furthermore, to the extent that the terms “includes,” “has,” “contains,” and other similar words are used in either the detailed description or the claims, for the avoidance of doubt, such terms are intended to be inclusive in a manner similar to the term “comprising” as an open transition word without precluding any additional or other elements.
It is to be appreciated that in accordance with one or more aspects described in this disclosure, users can opt-in or opt-out of providing personal information, demographic information, location information, proprietary information, sensitive information, or the like in connection with data gathering aspects. Moreover, one or more aspects described herein can provide for anonymizing collected, received, or transmitted data.
Apparatus, systems and/or methods disclosed herein relate to contact lenses that facilitate detection of fatigue and/or emotional state of a wearer of contact lenses. In some aspects, behavior of the eyelids (e.g., blinking, eyes closed, etc.), chemical or biomarkers can also be detected. For example, a contact lens can be configured to detect number of blinks of the eye within a predetermined duration of time. If the number of blinks exceeds a particular threshold, the contact lens can determine that the wearer of the contact lens is fatigued.
As another example, the contact lens can be configured to detect light. If no light is detected for a predetermined amount of time, the contact lens can determine that the wearer of the contact lens is asleep.
As another example, the contact lens can be configured to detect level of fluid retention around the eyes. If the level of fluid retention is above a predetermined threshold, the contact lens can determine that the wearer has puffy eyes and is fatigued.
As another example, the contact lens can detect chemical level (e.g., level of serotonin, dopamine, lactate, hydrogen ions or adrenaline) in the wearer of the contact lens. If the levels of serotonin or dopamine are above a predetermined threshold, the wearer can be determined to have a happy emotional state. If the level of adrenaline is less than a predetermined threshold, the wearer can be determined to be fatigued. If the level of lactate or hydrogen ions in above a predetermined threshold, the wearer can be determined to be fatigued.
In some aspects, a contact lens can include: a substrate; and a circuit. The circuit can include: one or more sensors disposed on or within the substrate, wherein the one or more sensors sense at least one of fatigue or an emotional state of a wearer of the contact lens; and an antenna disposed on or within the substrate, that communicates information sensed by the one or more sensors. In various aspects, alarms can be generated and/or notification of an alarm (or alarm condition) can be transmitted. In some aspects, a signal can be transmitted to cause a particular device being operated by the wearer of the contact lens to perform in a certain manner (e.g., cease operation, fail to commence operation).
In some aspects, a system can include: a contact lens that senses fatigue of a wearer of the contact lens; and a reader that receives a signal from the contact lens, the signal including information indicative of the fatigue of the wearer of the contact lens.
In some aspects, a method can include: sensing, using a contact lens, fatigue of a wearer of the contact lens, wherein the sensing is performed via one or more sensors disposed on or within the contact lens.
One or more aspects of the apparatus, systems and/or methods described herein can advantageously facilitate detection of fatigue and/or particular emotional states and, in some aspects, advantageously perform subsequent operations to enhance conduct and/or performance in daily operations. For example, in some aspects, detection of fatigue can lead to a determination (or inference) of whether a driver/pilot/surgeon is falling asleep (or is likely to fall asleep in the near future). In some aspects, the detection of fatigue can lead to a determination (or inference) of duration of different sleep cycles including, but not limited to, duration of rapid eye movement (REM) sleep. Such information can be particularly useful during sleep studies, for example. In some aspects, the emotional state can be monitored by a mental health professional to determine whether adjustment of medication may be desired.
FIG. 1 is an illustration of a block diagram of an exemplary non-limiting system that facilitates detection of fatigue and/or emotional states of wearers of contact lenses. The system 100 can include a light source 102 that emits light rays 104, a contact lens 106 that can facilitate detection of fatigue and/or emotional state of the wearer of the contact lens, a reader 108 that can receive information 110 indicative of the detected fatigue and/or emotional state of the wearer of the contact lens 106, an alarm generation component 112, an alarm action component 114 and/or a data logging component 116. While the system 100 displays light source 102, in some aspects, no light source is included in the system 100. Rather, ambient light is employed to detect fatigue and/or emotional states of wearers of the contact lenses. As such, the system 100 can include the contact lens 106, reader 108, alarm generation component 112, alarm action component 114 and/or data logging component 116. In one or more aspects, one or more of the components of system 100 can be communicatively and/or electrically (or optically) coupled to one another to perform one or more functions of the system 100.
Light 104 can be emitted from light source 102 and be incident on the contact lens 106. The contact lens 106 can include circuitry to determine (or infer) whether the wearer of the contact lens 106 is experiencing fatigue and/or to identify the emotional state of the wearer. In various aspects, the contact lens 106 can determine various eye behavior including, but not limited to, a duration of time during which the eye on which the contact lens 106 is worn is closed, the frequency of blinking of the eyelid, swollen or puffy eyes, level of adrenaline, epinephrine and/or norepinephrine in the body of the wearer of the contact lens 106. Eye behavior can also be employed to determine (or infer) whether the wearer of the contact lens 106 is experiencing fatigue and/or is asleep. For example, the circuit (not shown) of the contact lens 106 can be configured to detect number of blinks of the eye within a predetermined duration of time. If the number of blinks exceeds a particular threshold, the circuit can determine (or infer) that the wearer of the contact lens 106 is fatigued. As another example, the circuit can be configured to detect light. If no light is detected for a predetermined amount of time, the circuit can determine that the wearer of the contact lens 106 is asleep. As another example, the circuit can be configured to detect level of adrenaline, epinephrine and/or norepinephrine in the body of the wearer of the contact lens 106. If the level of adrenaline, epinephrine and/or norepinephrine in the body of the wearer of the contact lens 106 is lower than a predetermined threshold for the respective chemicals, the circuit can determine that the wearer is fatigued.
It is to be appreciated that in an embodiment, calibration can be performed to determine baseline (or reference) points corresponding to a first user state (e.g., not fatigued or in a normal emotional state), and variance from such baseline points can be employed to determine or infer level or user alertness, fatigue, emotional state, etc.
In another embodiment, a model can be developed based on sample data that can be employed for out of the box determination or inference regarding user state. In an aspect, the model can learn based on specific user behavior in order to converge on accurate predictions, determinations, or inference regarding user state. The model can be learned employing explicit and/or implicit training techniques.
The information 110 generated by the contact lens 106 can be transmitted to reader 108. The reader 108 can be a radio frequency (RF) reader that can receive signals from the contact lens 106.
The reader 108 and/or the alarm generation component 112 can determine or infer whether fatigue and/or a particular emotional state exists within the wearer of the contact lens 106. In some aspects, the contact lens 106 can make such determination. For example, in some aspects, the reader 108 can include threshold information that can be compared to level of chemicals (or number of blinks, etc.) output from the contact lens 106. The reader 108 can compare the levels or number of blinks, for example, to the threshold information. In aspects wherein the level of chemicals or number (or frequency) of blinks exceeds the respective threshold, the reader can send a signal to the alarm action component 114 and/or the alarm generation component 112. The alarm generation component 112 can generate an alarm based, at least, upon receiving the signal from the reader 108. The alarm action component 114 can perform one or more actions based, at least, on the receipt of the signal from the reader 108.
It is to be appreciated that in an embodiment artificial intelligence (AI) techniques can employed to perform a utility-based analysis (e.g., based on a probabilistic, statistical, deterministic, or non-deterministic framework) to assess the benefit of taking automated action against the cost of making an incorrect decision regarding such automated action.
As another example, the reader 108 can merely maintain a record of the chemical levels and/or number of blinks output from the contact lens 106. The record can be updated after the information detected at the contact lens 106 is communicated to the reader 108. The alarm action component 114 can monitor the record stored at the reader 108. If the information exceeds a threshold, the alarm generation component 112 can generate the alarm.
Based on a determination (or inference) that the wearer of the contact lens 106 is fatigued, is experiencing a particular emotional state and/or certain eye behavior has transpired, the alarm generation component 112 can generate an alarm. The alarm can be an audio, visual and/or textual alarm in various aspects.
The alarm can be transmitted to the wearer of the contact lens 106, to a supervisor of a wearer of the contact lens 106 and/or to a third-party monitoring agency (e.g., air traffic control). In various aspects, the alarm can be employed to identify individuals (e.g., factory line operator, surgeon, pilot) that may be fatigued and/or experiencing a particular emotional state and can benefit from a break.
Upon generation of the alarm, the alarm action component 114 can generate and/or send a signal to a device operated by the wearer of the contact lens 106. The signal can be adapted to control various aspects of the operation of the device. By way of example, but not limitation, the signal can cause operation of the device to cease (or cease after a selected amount of time after the alarm has been generated). By way of another example, the signal can cause operation of the device to alter in a manner that can facilitate desired conduct for the wearer of the contact lens 106 and/or others with which the wearer may come into contact. For example, the signal can cause the device to: issue a command to the wearer of the contact lens to prepare to cease operation of the device; issue a message that attempts to alert the wearer to the fatigue and/or emotional state of the wearer; and/or pull the device over to the side of a road on which the device may be operating.
The contact lens 106 will be described in greater detail with reference to FIGS. 2 and 3. In various aspects, the structure and/or functionality of contact lens 200 can be or include the structure and/or functionality of contact lens 106 (and vice versa).
Turning first to FIG. 2, the contact lens 200 can include a substrate 202 and a circuit 204 that can detect fatigue, emotional states and/or eye behavior of the wearer of the contact lens 200. The circuit can include one or more of the sensors 206, 208, a power component 210, a communication component 212, an analysis component 214, memory 216 and/or microprocessor 218. In various aspects, one or more of the sensors 206, 208, power component 210, communication component 212, analysis component 214, memory 216 and/or microprocessor 218 can be operably, electrically and/or communicatively coupled to one another to perform one or more functions of the circuit 204.
The sensors 206, 208 can be disposed on or within the substrate 202 of the contact lens 200. In various aspects, the sensors 206, 208 can sense information or eye behavior enabling a determination of fatigue or emotional state to be made by the circuit 204.
In various aspects, the sensors 206, 208 can sense whether a wearer of the contact lens 200 is fatigued based on sensing one or more chemicals or biomarkers in the body of the wearer of the contact lens 200. For example, levels of adrenaline, epinephrine, and/or norepinephrine below a particular threshold can be detected and can be determined to indicate fatigue. As another example, level of lactate or hydrogen ions above a particular threshold can be detected and can be determined to indicate fatigue. As another example, a level of fluid near the eye can indicate the level of puffiness of the eye. The level of fluid can be employed to determine (or infer) whether the wearer is fatigued.
In various aspects, the sensors 206, 208 can detect neural and/or electromyogram activity of the wearer of the contact lens 200 to determine whether the wearer of the contact lens 200 is fatigued. For example, the sensors 206, 208 can detect electrical activity from nerve cells in the eye muscles. The electromyogram activity can be the electrical activity from the nerve cells in the eye muscles. If the amount of electrical activity decreases by a predetermined amount over a particular time period, the contact lens 200 can determine that the wearer is fatigued.
In some aspects, the sensors 206, 208 can sense light. As such, the sensors 206, 208 can sense duration of time during which the eye is closed. For example, the duration of time can be the duration of time during which no light is detected at the sensors 206, 208. In some aspects, the duration of time during which the eye is closed can be employed to determine whether a wearer of the contact lens 200 is fatigued or asleep. In an aspect, light detection can also be used to determine frequency of blinking.
In some aspects, the sensors 206, 208 can sense pressure incident on and/or temperature of the contact lens 200 and/or the sensors 206, 208. For example, detection of pressure on and/or temperature on the contact lens 200 and/or sensors 206, 208 can be employed to determine that the eye is closed. By way of example, but not limitation, the pressure can be sensed by a pressure transducer that converts pressure to electricity and/or a MEMS-based device that generates electricity upon a selected amount of pressure (and corresponding stress) being applied to the device. The contact lens 200 can detect the pressure applied to the contact lens 200 based, at least, on the amount of electricity generated on the contact lens 200 in some aspects.
In some aspects, the sensors 206, 208 can sense conductivity within the contact lens. The conductivity can be employed to detect the eye behavior (e.g., blinking). For example, the tissue of the eyelid for the eye over which the contact lens is disposed can have a certain conductivity. The conductivity can increase or decrease based, at least, upon whether the eyelid is open or closed. Accordingly, the conductivity can be a function of the number of times that the eyelid has performed an open and close operation, or a blink operation. The conductivity can be measured and a determination can be made as to whether the conductivity is above a predetermined threshold (for a certain amount of time, e.g., 5 blinks per 20 seconds) that indicates a certain number of blinks. If the conductivity is above the threshold, the contact lens can determine that the wearer is blinking frequently. Blinking frequently can be an indication of fatigue.
As described, in some aspects, a light source can be external to the contact lens 200, and the sensors 206, 208 can sense whether the eye is closed or opened by measuring when the light from the light source is blocked by the eyelid. As such, the sensors 206, 208 can determine whether an eye is open or closed based on this circuitry and/or approach as well. In various aspects, the light source can be ambient light or light from a specified external source.
In various aspects, the sensors 206, 208 can sense the emotional state of the wearer of the contact lens. For example, the emotional state can include, but is not limited to, whether the wearer is happy or sad and/or whether the wearer is experiencing anxiety or a particular stress level. For example, the sensors 206, 208 can sense a level of one or more chemicals (e.g., endorphins, serotonin) in the body of the wearer of the contact lens. If the level is greater than a predetermined value, the emotional state of the wearer can be determined to be happy (or experiencing a stress level that is relatively low). Similarly, if the level is less than a value the emotional state of the wearer can be determined to be sad (or having anxiety).
The analysis component 214 can receive the information sensed by the sensors 206, 208. The analysis component 214 can perform analysis to determine whether particular eye behavior (e.g., blinking) has occurred and/or whether the wearer of the contact lens 200 is fatigued and/or experiencing a particular emotional state.
The analysis component 214 can be described in another aspect such as that shown in FIG. 3. Analysis component 214′ can include structure and/or functionality of that described with reference to analysis component 214 (or vice versa). Turning to FIG. 3, in one aspect, the analysis component 214′ can include a fatigue determination component 300 that can determine whether the wearer of the contact lens 200 is fatigued, an emotional state determination component 302 that can determine the emotional state of the wearer of the contact lens 200 and/or an eye behavior determination component 304 that can determine behavior (e.g., blinking, eyes closed or open) of the eye of the wearer of the contact lens 200. In some aspects, the analysis component 214′ can include a memory 306 and/or a microprocessor 308. In some aspects, the memory 306 and/or microprocessor 308 can be separate from the memory 216 and the microprocessor 218. In other aspects, a single memory and a single microprocessor can be employed on the contact lens 200.
The communication component 212 can communicate with an external reader or other device external to the contact lens 200. In some aspects, the communication component 212 can include an antenna that can communicate with an RF reader. In various aspects, the information communicated by the communication component 212 can be “eye open,” “eye closed” and/or information indicative of a biomarker level that can indicate fatigue or an emotional state.
The power component 210 can receive and/or provide power to the sensors 206, 208, communication component 212, analysis component 214, memory 216 and/or microprocessor 218.
In some aspects, the analysis component 214 is not included on the contact lens 200 and the information sensed by the one or more sensors 206, 208 is transmitted to an external reader. The external reader can determine whether particular eye behavior (e.g., blinking) has occurred and/or whether the wearer of the contact lens 200 is fatigued and/or experiencing a particular emotional state.
If fatigue, particular eye behavior and/or a particular emotional state is detected, various actions can be taken including, but not limited to, sending a signal to cause a vehicle being operated by the wearer of the contact lens 200 to pull the vehicle off to the side of the road, alerting or removing an operator (e.g., surgeon, surgical resident, pilot, truck driver, bus driver, factory line employee) from duties.
The memory 216 can be a computer-readable storage medium storing computer-executable instructions and/or information for performing the functions described in this disclosure with reference to the contact lens 200 (or components thereof). The microprocessor 218 can perform one or more of the functions described in this disclosure with reference to the contact lens 200 (or components thereof).
Although one configuration of components is shown for the circuit 204. In other aspects, the circuit 204 can be in any number of other different types of configurations. Further, while the description of FIG. 2 describes two sensors 206, 208, in other aspects, the circuit 204 can include one or more sensors to detect fatigue, emotional states and/or eye behavior.
FIGS. 4, 5, 6, 7 and 8 are illustrations of exemplary flow diagrams of methods that facilitate detection of fatigue and/or emotional states of wearers of contact lenses. Turning first to FIG. 4, at 402, method 400 can include sensing, using a contact lens, fatigue of a wearer of a contact lens (e.g., using one or more of the sensors 206, 208). As noted, in some aspects, the sensing is performed via one or more sensors disposed on or within the contact lens.
In various aspects, the fatigue can be sensed by sensing neural activity, electromyogram activity and/or a biomarker level of the wearer of the contact lens.
Although not shown, in some aspects, a method can include sensing the behavior of an eye over which the contact lens is disposed. The behavior can include a duration during which the eye is closed and/or a frequency of blinking of the eyelid. Such information can be employed to deduce fatigue in various aspects (e.g., if blink events are detected to be exceeding a threshold of 5 blinks per minute, for example, the system may deduce that the wearer is fatigued).
At 404, method 400 can include outputting information indicative of the sensed fatigue (e.g., using the communication component 212).
Turning now to FIG. 5, at 502, method 500 can include sensing, using a contact lens, fatigue of the wearer of the contact lens (e.g., using one or more of the sensors 206, 208). In various aspects, the fatigue can be sensed by sensing neural activity, electromyogram activity and/or a biomarker level of the wearer of the contact lens. For example, as described above, the sensors 206, 208 can detect the electrical activity from nerve cells in the eye muscles. The electromyogram activity can be the electrical activity from the nerve cells in the eye muscles. If the amount of electrical activity decreases by a predetermined amount over a particular time period, the contact lens 200 can determine that the wearer is fatigued. As another example, in various aspects, levels of adrenaline, epinephrine, and/or norepinephrine below a particular threshold can be detected and can be determined to indicate fatigue. As another example, a level of lactate or hydrogen ions above a particular threshold can be detected and can be determined to indicate fatigue. As another example, a level of fluid near the eye can indicate the level of puffiness of the eye. The level of fluid can be employed to determine whether the wearer is fatigued.
At 504, method 500 can include transmitting a signal from the contact lens to a reader (e.g., using the communication component 212). In various aspects, the signal can include information indicative of the fatigue of the wearer of the contact lens. The information indicative of the fatigue can include, but is not limited to, electrical activity from nerve cells in the eye muscles, a number of blinks of the eyelid over a period of time, and/or a level of adrenaline, epinephrine, norepinephrine, lactate and/or hydrogen ions in the fluid incident on the contact lens.
At 506, method 500 can include generating an alarm based, at least, on the information indicative of the fatigue of the wearer of the contact lens (e.g., using the alarm generation component 112).
Turning now to FIG. 6, at 602, method 600 can include sensing, using a contact lens, fatigue of a wearer of the contact lens (e.g., using one or more of the sensors 206, 208). In various aspects, the fatigue can be sensed by sensing neural activity, electromyogram activity and/or a biomarker level of the wearer of the contact lens. For example, as described above, the sensors 206, 208 can detect the electrical activity from nerve cells in the eye muscles. The electromyogram activity can be the electrical activity from the nerve cells in the eye muscles. If the amount of electrical activity decreases by a predetermined amount over a particular time period, the contact lens 200 can determine that the wearer is fatigued. As another example, in various aspects, levels of adrenaline, epinephrine, and/or norepinephrine below a particular threshold can be detected and can be determined to indicate fatigue. As another example, a level of lactate or hydrogen ions above a particular threshold can be detected and can be determined to indicate fatigue. As another example, a level of fluid near the eye can indicate the level of puffiness of the eye. The level of fluid can be employed to determine whether the wearer is fatigued
At 604, method 600 can include transmitting a signal from the contact lens to a reader (e.g., using the communication component 212). In various aspects, the signal can include information indicative of the fatigue of the wearer of the contact lens.
At 606, method 600 can include generating an alarm based, at least, on the information indicative of the fatigue of the wearer of the contact lens (e.g., using the alarm generation component 112).
At 608, method 600 can include transmitting a notification of the alarm to a third-party in response to the generating the alarm (e.g., using the alarm action component 114).
Turning now to FIG. 7, at 702, method 700 can include sensing, using a contact lens, fatigue of the wearer of the contact lens (e.g., using one or more of the sensors 206, 208). In various aspects, the fatigue can be sensed by sensing neural activity, electromyogram activity and/or a biomarker level of the wearer of the contact lens. For example, as described above, the sensors 206, 208 can detect the electrical activity from nerve cells in the eye muscles. The electromyogram activity can be the electrical activity from the nerve cells in the eye muscles. If the amount of electrical activity decreases by a predetermined amount over a particular time period, the contact lens 200 can determine that the wearer is fatigued. As another example, in various aspects, levels of adrenaline, epinephrine, and/or norepinephrine below a particular threshold can be detected and can be determined to indicate fatigue. As another example, level of lactate or hydrogen ions above a particular threshold can be detected and can be determined to indicate fatigue. As another example, a level of fluid near the eye can indicate the level of puffiness of the eye. The level of fluid can be employed to determine (or infer) whether the wearer is fatigued
At 704, method 700 can include transmitting a signal from the contact lens to a reader (e.g., using the communication component 212). In various aspects, the signal can include information indicative of the fatigue of the wearer of the contact lens.
At 706, method 700 can include generating an alarm based, at least, on the information indicative of the fatigue of the wearer of the contact lens (e.g., using the alarm generation component 112).
At 708, method 700 can include generating a signal to control a device (e.g., using the alarm action component 114). In various aspects, the device can be operated by the wearer of the contact lens. The device can include, but is not limited to, a motorized vehicle, aircraft, machinery, electrically-powered surgical instrument or the like.
In some aspects, the signal can cause the device to cease operation and/or control the device to cause a more desirable condition to be effected. By way of example, but not limitation, in some aspects, the signal can cause the device to cease operation, fail to start operation and/or cease operation after a predetermined amount of time has passed after generation of the alarm and/or notification of the alarm. For example, the signal can be communicated to a base station or third-party that can transmit a wireless signal (from the BS or a satellite communicatively coupled to the device) causing the device to cease operation.
In some aspects, although not shown, the information from the sensor can be recorded in a data logging component. As such, information and/or trends of alarm times or the like can be recorded and/or provided to a wearer of the contact lens. Accordingly, the wearer can be informed as to particular times or days that have a higher frequency of fatigue and/or emotional state leading to an alarm.
Turning now to FIG. 8, at 802, method 800 can include sensing, using a contact lens, an emotional state of a wearer of a contact lens (e.g., using one or more of the sensors 206, 208). In various aspects, the sensing can be performed via one or more of the sensors disposed on or within the contact lens.
In some aspects, the emotional state of the wearer of the contact lens can be sensed in addition to or in lieu of the fatigue. In various aspects, the emotional state can include, but is not limited to, whether the wearer is happy or sad. For example, in some aspects, a level of one or more chemicals (e.g., endorphins, serotonin) can be sensed in the body of the wearer of the contact lens. If the level is greater than a predetermined value, the emotional state of the wearer can be determined to be happy. Similarly, if the level is less than a value the emotional state of the wearer can be determined to be sad.
At 804, method 800 can include outputting information indicative of the sensed emotional state (e.g., using the communication component 212).
Exemplary Networked and Distributed Environments
FIG. 9 provides a schematic diagram of an exemplary networked or distributed computing environment with which one or more aspects described in this disclosure can be associated. The distributed computing environment includes computing objects 910, 912, etc. and computing objects or devices 920, 922, 924, 926, 928, etc., which can include programs, methods, data stores, programmable logic, etc., as represented by applications 930, 932, 934, 936, 938. It can be appreciated that computing objects 910, 912, etc. and computing objects or devices 920, 922, 924, 926, 928, etc. can include different devices, such as active contact lenses (and components thereof), personal digital assistants (PDAs), audio/video devices, mobile phones, MPEG-1 Audio Layer 3 (MP3) players, personal computers, laptops, tablets, etc.
Each computing object 910, 912, etc. and computing objects or devices 920, 922, 924, 926, 928, etc. can communicate with one or more other computing objects 910, 912, etc. and computing objects or devices 920, 922, 924, 926, 928, etc. by way of the communications network 940, either directly or indirectly. Even though illustrated as a single element in FIG. 9, network 940 can include other computing objects and computing devices that provide services to the system of FIG. 9, and/or can represent multiple interconnected networks, which are not shown.
In a network environment in which the communications network/bus 940 can be the Internet, the computing objects 910, 912, etc. can be Web servers, file servers, media servers, etc. with which the client computing objects or devices 920, 922, 924, 926, 928, etc. communicate via any of a number of known protocols, such as the hypertext transfer protocol (HTTP).
Exemplary Computing Device
As mentioned, advantageously, the techniques described in this disclosure can be associated with any suitable device. It is to be understood, therefore, that handheld, portable and other computing devices (including active contact lens having circuitry or components that compute and/or perform various functions). As described, in some aspects, the device can be the contact lens (or components of the contact lens) and/or reader described herein. In various aspects, the data store can include or be included within, any of the memory described herein, any of the contact lenses described herein and/or the RF reader described herein. In various aspects, the data store can be any repository for storing information transmitted to or received from the contact lens.
FIG. 10 illustrates an example of a suitable computing system environment 1000 in which one or aspects of the aspects described in this disclosure can be implemented. Components of computer 1010 can include, but are not limited to, a processing unit 1020, a system memory 1030, and a system bus 1022 that couples various system components including the system memory to the processing unit 1020.
Computer 1010 typically includes a variety of computer readable media and can be any available media that can be accessed by computer 1010. The system memory 1030 can include computer storage media in the form of volatile and/or nonvolatile memory such as read only memory (ROM) and/or random access memory (RAM). By way of example, and not limitation, memory 1030 can also include an operating system, application programs, other program components, and program data.
A user can enter commands and information into the computer 1010 through input devices 1040 (e.g., keyboard, keypad, a pointing device, a mouse, stylus, touchpad, touch screen, motion detector, camera, microphone or any other device that allows the user to interact with the computer 1010). A monitor or other type of display device can be also connected to the system bus 1022 via an interface, such as output interface 1050. In addition to a monitor, computers can also include other peripheral output devices such as speakers and a printer, which can be connected through output interface 1050.
The computer 1010 can operate in a networked or distributed environment using logical connections to one or more other remote computers, such as remote computer 1080. The remote computer 1080 can be a personal computer, a server, a router, a network PC, a peer device or other common network node, or any other remote media consumption or transmission device, and can include any or all of the elements described above relative to the computer 1010. The logical connections depicted in FIG. 10 include a network 1082, such local area network (LAN) or a wide area network (WAN), but can also include other networks/buses e.g., cellular networks.
Computing devices typically include a variety of media, which can include computer-readable storage media and/or communications media, in which these two terms are used herein differently from one another as follows. Computer-readable storage media can be any available storage media that can be accessed by the computer, can be typically of a non-transitory nature, and can include both volatile and nonvolatile media, removable and non-removable media. By way of example, and not limitation, computer-readable storage media can be implemented in connection with any method or technology for storage of information such as computer-readable instructions, program components, structured data, or unstructured data. Computer-readable storage media can include, but are not limited to, RAM, ROM, electrically erasable programmable read only memory (EEPROM), flash memory or other memory technology, or other tangible and/or non-transitory media which can be used to store desired information. Computer-readable storage media can be accessed by one or more local or remote computing devices, e.g., via access requests, queries or other data retrieval protocols, for a variety of operations with respect to the information stored by the medium. In various aspects, the computer-readable storage media can be, or be included within, the memory, contact lens (or components thereof) or reader described herein.
On the other hand, communications media typically embody computer-readable instructions, data structures, program components or other structured or unstructured data in a data signal such as a modulated data signal, e.g., a carrier wave or other transport mechanism, and includes any information delivery or transport media. The term “modulated data signal” or signals refers to a signal that has one or more of its characteristics set or changed in such a manner as to encode information in one or more signals.
It is to be understood that the aspects described in this disclosure can be implemented in hardware, software, firmware, middleware, microcode, or any combination thereof. For a hardware aspect, the processing units can be implemented within one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), processors, controllers, micro-controllers, microprocessors and/or other electronic units designed to perform the functions described in this disclosure, or a combination thereof.
For a software aspect, the techniques described in this disclosure can be implemented with components or components (e.g., procedures, functions, and so on) that perform the functions described in this disclosure. The software codes can be stored in memory units and executed by processors.
What has been described above includes examples of one or more aspects. It is, of course, not possible to describe every conceivable combination of components or methodologies for purposes of describing the aforementioned aspects, but one of ordinary skill in the art can recognize that many further combinations and permutations of various aspects are possible. Accordingly, the described aspects are intended to embrace all such alterations, modifications and variations that fall within the spirit and scope of the appended claims.
Moreover, the term “or” is intended to mean an inclusive “or” rather than an exclusive “or.” That is, unless specified otherwise, or clear from the context, the phrase “X employs A or B” is intended to mean any of the natural inclusive permutations. That is, the phrase “X employs A or B” is satisfied by any of the following instances: X employs A; X employs B; or X employs both A and B. In addition, the articles “a” and “an” as used in this application and the appended claims should generally be construed to mean “one or more” unless specified otherwise or clear from the context to be directed to a singular form.
The aforementioned systems have been described with respect to interaction between several components. It can be appreciated that such systems and components can include those components or specified sub-components. Sub-components can also be implemented as components communicatively coupled to other components rather than included within parent components (hierarchical). Additionally, it is to be noted that one or more components can be combined into a single component providing aggregate functionality. Any components described in this disclosure can also interact with one or more other components not specifically described in this disclosure but generally known by those of skill in the art.
In view of the exemplary systems described above methodologies that can be implemented in accordance with the described subject matter will be better appreciated with reference to the flowcharts of the various figures. While for purposes of simplicity of explanation, the methodologies are shown and described as a series of blocks, it is to be understood and appreciated that the claimed subject matter is not limited by the order of the blocks, as some blocks can occur in different orders and/or concurrently with other blocks from what is depicted and described in this disclosure. Where non-sequential, or branched, flow is illustrated via flowchart, it can be appreciated that various other branches, flow paths, and orders of the blocks, can be implemented which achieve the same or a similar result. Moreover, not all illustrated blocks may be required to implement the methodologies described in this disclosure after.
In addition to the various aspects described in this disclosure, it is to be understood that other similar aspects can be used or modifications and additions can be made to the described aspect(s) for performing the same or equivalent function of the corresponding aspect(s) without deviating there from. Still further, multiple processing chips or multiple devices can share the performance of one or more functions described in this disclosure, and similarly, storage can be provided across a plurality of devices. The invention is not to be limited to any single aspect, but rather can be construed in breadth, spirit and scope in accordance with the appended claims.

## Claims

1. A contact lens, comprising:
a substrate; and
a circuit comprising:
one or more sensors, disposed on or within the substrate, wherein the one or more sensors include at least one light sensor configured to sense at least one of a duration of closure of an eyelid or a frequency of blinking; and
an antenna disposed on or within the substrate, configured to communicate information sensed by the one or more sensors to a reader, wherein the information sensed by the one or more sensors is indicative of fatigue of a wearer of the contact lens based on calibration data, wherein the reader is configured to send a signal to at least one component based on the information indicative of fatigue of the wearer of the contact lens.

2. The contact lens of claim 1, wherein the information sensed by the one or more sensors is further indicative of an emotional state of the wearer of the contact lens.

3. The contact lens of claim 1, wherein the one or more sensors further include at least one sensor configured to sense at least one of neural activity or electromyogram activity of the wearer of the contact lens.

4. The contact lens of claim 1, wherein the one or more sensors further include at least one sensor configured to sense a level of fluid retention around an eye over which the contact lens is disposed.

5. The contact lens of claim 1, wherein the one or more sensors further include at least one sensor configured to sense a level of at least one of lactate, hydrogen ions, adrenaline, serotonin, dopamine, epinephrine or norepinephrine.

6. The contact lens of claim 1, wherein the calibration data comprises a baseline corresponding to a non-fatigued state of the wearer of the contact lens, such that a variance from the baseline is indicative of a fatigued state of the wearer of the contact lens.

7. The contact lens of claim 1, wherein the at least one component comprises a component configured to generate an alarm based on the signal from the reader.

8. The contact lens of claim 1, wherein the at least one component comprises a component configure to control a device operated by the wearer of the contact lens based on the signal from the reader.

9. The contact lens of claim 1, wherein the at least one component comprises a data logging component.

10. The contact lens of claim 1, wherein the reader is configured to compare the information sensed by the one or more sensors to one more thresholds.

11. A method, comprising:
sensing, using a contact lens, fatigue of a wearer of the contact lens, wherein the sensing is performed via one or more sensors disposed on or within the contact lens, wherein the one or more sensors include at least one light sensor configured to sense at least one of a duration of closure of an eyelid or a frequency of blinking; and
communicating information sensed by the one or more sensors to a reader, wherein the information sensed by the one or more sensors is indicative of fatigue of the wearer of the contact lens based on calibration data, wherein the reader is configured to send a signal to at least one component based on the information indicative of fatigue of the wearer of the contact lens.

12. The method of claim 11, further comprising sensing an emotional state of the wearer of the contact lens.

13. The method of claim 12, wherein the sensing the emotional state comprises sensing a level of at least one of dopamine or serotonin.

14. The method of claim 11, wherein the sensing the fatigue comprises sensing at least one of neural activity or electromyogram activity of the wearer of the contact lens.

15. The method of claim 11, wherein the one or more sensors further include at least one sensor configured to sense a level of fluid near an eye over which the contact lens is disposed.

16. The method of claim 11, wherein the calibration data comprises a baseline corresponding to a non-fatigued state of the wearer of the contact lens, such that a variance from the baseline is indicative of a fatigued state of the wearer of the contact lens.

17. The method of claim 11, wherein the at least one component comprises a component configured to generate an alarm based on the signal from the reader.

18. The method of claim 11, wherein the at least one component comprises a component configure to control a device operated by the wearer of the contact lens based on the signal from the reader.

19. The method of claim 11, wherein the at least one component comprises a data logging component.

20. The method of claim 11, wherein the reader is configured to compare the information sensed by the one or more sensors to one more thresholds.