# Design of a Multimodal Oculometric Sensor Contact Lens

Jean-Louis de Bougrenet de la Tocnaye, Vincent Nourrit, Cyril Lahuec

► To cite this version:

Jean-Louis de Bougrenet de la Tocnaye, Vincent Nourrit, Cyril Lahuec. Design of a Multimodal Oculometric Sensor Contact Lens. Sensors, 2022, 22 (18), pp.6731. 10.3390/s22186731. hal-03772668

HAL Id: hal-03772668

https://hal.science/hal-03772668v1

Submitted on 8 Sep 2022

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>

Distributed under a Creative Commons CC BY 4.0 - Attribution - International License
# Design of a Multimodal Oculometric Sensor Contact Lens

Jean-Louis de Bougrenet de la Tocnaye <fnref n="1" />*, Vincent Nourrit <fnref n="1" /> ID and Cyril Lahuec <fnref n="1" />,<fnref n="2" /> ID

**Abstract:** Oculometric data, such as gaze direction, pupil size and accommodative change, play a key role nowadays in the analysis of cognitive load and attentional activities, in particular with the development of Integrated Visual Augmentation Systems in many application domains, such as health, defense and industry. Such measurements are most frequently obtained by different devices, most of them requiring steady eye and body positions and controlled lighting conditions. Recent advances in smart contact lens (SCL) technology have demonstrated the ability to achieve highly reliable and accurate measurements, preserving user mobility, for instance in measuring gaze direction. In this paper, we discuss how these three key functions can be implemented and combined in the same SCL, considering the limited volume and energy consumption constraints. Some technical options are discussed and compared in terms of their ability to be implemented, taking advantage of recent developments in the field.

**Keywords:** smart contact lens; eye-tracking; pupil size; accommodation; diffractive optical element

<figure><img src="image_2.png" /></figure>

check for
updates

**Citation:** de Bougrenet de la Tocnaye, J.-L.; Nourrit, V.; Lahuec, C. Design of a Multimodal Oculometric Sensor Contact Lens. *Sensors* **2022**, *22*, 6731. https://doi.org/10.3390/s22186731

Academic Editors: Ki-Nam Joo, Felipe Guzman and Young-Jin Kim

Received: 13 July 2022
Accepted: 2 September 2022
Published: 6 September 2022

**Publisher's Note:** MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

<figure><img src="image_3.png" /></figure>

**Copyright:** © 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).

## 1. Introduction

Different multimodal features related to peripheral physiology, brain activity, and oculometric reactions have been used as non-intrusive, reliable, and objective measures of cognitive load and attention [1]. In this paper, we focus on three of them: gaze direction (GD), pupil dilation (PD) and accommodative power (AP). A blinking measurement can also be easily added [2]. Numerous works have shown that these oculometric features provide complementary information about the subject's cognitive load and attention, and yield great benefits when combined. Furthermore, the solutions used to implement them share some common elements that could be mutualized. This emphasizes their ability to be brought together, and then be miniaturized to become portable and provide the user with full mobility. In addition, the measurement of most of them demands the control of eye motion and the lighting conditions [3]. With the development of Integrated Visual Augmentation Systems (IVASs), these approaches could easily be incorporated into said systems to provide accurate and reliable data, regardless of eye movement and the wearer's motions. In consequence, the eye is the best location for their integration.

The use of smart contact lenses (SCL) in human-machine interactions (HMIs) has received attention recently with the joint development of IVAS and nanotechnologies [4]. For instance, the Sony blink-powered SCL records everything the user sees, using a picture-taking unit, and a piezoelectric sensor capable of detecting the difference between voluntary and involuntary blinks [5]. California University developed a robotic telescopic SCL to zoom in on objects of interest by blinking [6]. Among the visual HMIs [7], eye-trackers have become some of the most popular interfaces for assessing and modulating sensorimotor and cognitive functions. For instance, they have been used for a wide variety of tasks, from the most basic, such as selection, manipulation and navigation [8,9], to assessing

<footnote n="1">¹ Optics Department, Institut Mines-Télécom Atlantique, Technopôle Brest Iroise, CS 83818, CEDEX 03, 29238 Brest, Brittany, France</footnote>

<footnote n="2">² Laboratoire des Sciences et Techniques de l'Information, de la Communication et de la Connaissance, CNRS UMR 6285, 29238 Brest, Brittany, France</footnote>

<footnote>* Correspondence: jl.debougrenet@imt-atlantique.fr</footnote>
mental workload [10], passing by probing memory [11] and analyzing programming
technologies [12].

In the future of IVAS, eyes will replace standard tools such as cursors, touch-screens, touchpads and keyboards to convey visual intents or commands, and to identify cognitive loads. Therefore, a reliable control of oculometric parameters is a prerequisite when using the eye as an HMI to control where the user's attention is focused, or to perform visual designations, thus reducing the operators' workload and allowing them to concentrate on their main mission, while establishing a new link between planning, control functionalities, and sensory coordination [13]. More generally, such devices are a key element for investigating the impact of multitasking, which is characteristic of the use of mixed reality systems, on our cognitive performance, in combination with other cost-effective Brain-Computer Interfaces (BCIs), such as those described in [14].

We propose here to analyze the various ways to implement gaze direction, accom-
modative power and pupil size measurements, all of which are operations that are worth
implementing on the same contact lens. We recently developed an eye-tracker SCL, and
the purpose of this study is to develop a way to measure pupil size and accommodative
power simultaneously, while optimizing the number of embedded circuits, the technical
complexity, the manufacturing ability and the energy consumption.

## 2. Implementation in an SCL

In this section, we discuss how these functions can be implemented in an SCL. Two
main options can be considered. Each sensor delivers specific data (i.e., angle of sight,
pupil size, accommodation). These data are either computed at the SCL level and then
transmitted via a data link to an external device monitoring the SCL (e.g., eyewear, AR
headsets etc.), or used to activate sensors mounted in this monitoring device, which extracts
and processes the information at this level. Both options have advantages and drawbacks,
which are discussed here. Another obvious requisite for SCL is steadiness when on the eyes.
This is obtained using a scleral contact lens, which has the particular features of being stable
on the eye and having no direct contact with the cornea. Finally, the SCL has its own energy
resource, enabling the on-board functions to operate and wirelessly communicate [15],
activate, deactivate, and transfer data to the monitoring device (e.g., goggles, mixed reality
headset, etc.).

2.1. *Eye Gaze SCL*

We have developed two prototypes that implement this function [16,17]. Both make
use of an instrumented SCL and eyewear. In the first case, shown in Figure 1a, the
lens integrates four photodiodes (PTD) illuminated by an infrared source placed on the
glasses [16]. The amount of light reaching each photodiode varies with the direction of gaze,
and thus this direction can be calculated from the centroid of the PTDs currents. The lens
is embedded with an ASIC to perform this calculation, as well as a transmission module
to send this data to a sensor on the eyewear. A demonstration with a mock-up achieved
0.11° accuracy with 0.01° precision, which is almost an order of magnitude better than
the results achieved by the best commercial head-mounted eye trackers. The secondary
antenna was not in the SCL, as seen Figure 1a. In the second case, shown in Figure 1b, the
light source was placed within the SCL [17], and the sensor was on the eyewear. More
precisely, the SCL contains a VCSEL, which allows the measurement of the direction of
gaze with 0.03° accuracy. The detection of the beam can be achieved using a camera or
a PSD (which has advantages in terms of integration and speed). In this case, the SCL
incorporated a secondary antenna.
<figure><img src="image_4.png" /><figcaption>**Figure 1.** SCL with the eyewear: (a) SCL encapsulating four photodiodes (1), an ASIC and a communication module (2); (b) SCL encapsulating two VCSELs (3) used as a laser pointer.</figcaption></figure>

## 2.2. Pupillometer SCL

This model is a natural extension of the previous. An SCL including at least one light source, preferably a laser, is combined with an optical detector, allowing the measurement of pupillary diameter. This SCL is coupled with a device for measuring the pupil diameter. The on-board source provides light reflected by the iris surface and analyzed either at the level of the SCL or externally by a suitable device. The pupil size measurement can be done without the voluntary participation of the subject. The novelty lies in the nature of the iris illumination approach [18], the method of reflected beam detection, and especially in the fact that these operations are embedded in an SCL that communicates wirelessly. In contrast to the previous embodiments [16,17], the light source and the optical sensor are oriented towards the retina, pointing at the iris. They are assembled on the inner surface of the electronic circuit. The resourcing and communicating antenna can be arranged on the same side of the periphery of the circuit, as shown in Figure 1b. As said above, such a device allows two distinct modes of implementation.

* Both the emission source and the detector (i.e., a photodiode) are in the SCL. In this case, a variation in light intensity is measured (reflected by the portion of the pupil illuminated by the light source—the rest is absorbed in the interior of the eye). A look-up table makes it possible to determine the pupil diameter. This value is computed within the contact lens and transmitted to the eyewear via a conventional NFC link, as in [15]. The principle is illustrated in Figure 2.

The device uses dedicated NXP or ST chips to construct a sensor powered by an NFC protocol. They contain a microcontroller and an ADC converter, and allow energy recovery and data transmission via NFC [15]. In Figure 2, the sensor is on the opposite side of the pupil with respect to the light source, but they could also be placed side by side. The pupil diameter varies between 2 and 8 mm. The light source should illuminate a section of the iris between Rmin and Rmax with, for example, Rmin = 1.5 mm and Rmax = 3 mm. In order to allow the light source to illuminate this entire area, it may be worthwhile to lengthen the
optical path. For example, the light source is directed outwards and guided by multiple reflections, as described in [19]. Beam shaping can also be considered using micro-optics, as described in [20], to better illuminate the iris' arc of interest. The laser beam's direction can be accurately controlled as well, as shown in [20].

<figure><img src="image_5.png" /><figcaption>**Figure 2.** Datacom-based solution: ray-tracing taking into account the different optical interfaces.</figcaption></figure>

* The second solution combines a light source and a diffractive optical element (DOE) [20,21], which covers a given area of the iris. This optical element will therefore be partially illuminated with respect to the proportion of light that is reflected from the portion of the iris underlying it (as detailed later on). For this purpose, the DOE [22,23] consists of several facets, each of which creates a light spot at a given distance from the lens, where detectors are placed to determine the diameter of the iris opening. This implementation is illustrated in Figure 3a (operation) and Figure 3b (obtained ray-tracing).

A possible mode of implementation involving an external detection system is based on the use of a micro-optics array (blazed gratings or off-axis Fresnel lenses array, as shown in Figure 4) as the DOE. The reflection on the semi-diffusing surface of the iris has the effect of reducing the coherence of the laser source (a VCSEL here); hence, the use of this type of component is appropriate here.

<figure><img src="image_6.png" /><figcaption>**Figure 3.** (a) Schematic representation of the operation principle: part of the emitted light is reflected by the pupil and detected by a sensor, or impacts a DOE; (b) ray-tracing taking into account the different optical interfaces.</figcaption></figure>

For simplicity, the cornea is not represented in the picture; the index of the aqueous humor (1.336), the cornea (1.376) and the lacrimal fluid (1.33) being close, the influence of the cornea refractive power can be neglected if the incidence angle on the cornea is not too large. Hence, the beam reflected from the iris illuminates partially or fully the
DOE, depending on the degree of pupil opening. The object focal plane of these lenses is preferably the laser source (not the case in Figure 5). This configuration makes it possible to introduce a 1D detector array (e.g., photodiodes) at a given distance (a few cm), as shown in Figure 6. This figure describes a PRAR SCL (Figure 6a [19]) coupled with an AR headset (Figure 6b), and shows how the liseran IR pointer is detected at the display frame to determine the eye direction and/or activate some headset functions. Here, in our case, the spot detection on each of these detectors allows the pupil size to be derived. The configuration also makes it possible to consider horizontal eye movement (the most relevant) by replacing the 1D array with a matrix of detectors covering a given angular sector (e.g., 15°).

<figure><img src="image_7.png" /><figcaption>**Figure 4.** Example of DOE using an off-axis Fresnel lens pattern (i.e., focusing with an axial shift that can be integrated) for four positions.</figcaption></figure>

<figure><img src="image_8.png" /><figcaption>**Figure 5.** Example of the DOE mode of use when the sensor is outside the lens. Here, four micro-lenses form one to four focal spots, depending on the size of the pupil and thus of the iris surface illuminated.</figcaption></figure>

<figure><img src="image_9.png" /><figcaption>**Figure 6.** (a) SCL configuration when the sensor is not embedded in the lens. (b) Several 1D arrays (vertical) could be assembled horizontally (forming a 2D matrix) to include horizontal eye rotation.</figcaption></figure>
This solution liberates the choice of the detector array, allowing a better light sensitivity and detector surface. At the SCL level, it simplifies the implementation. There is no need for a photodiode or NXP devices, which is beneficial in terms of energy consumption and volume, keeping the SCL free for embedding other functions. The integration of DOE, which is a flat and passive device, has been tested elsewhere [20].

## 2.3. Aut refractometer SCL

As described in a previous paragraph, various techniques are available to measure the refractive error, most of them relying on recording how light from an infrared source reflects off the retina, and requiring a precise alignment between the infrared source, the eye and the detector. Some of these techniques may be adapted for implementation in an SCL. The first possible means of implementation is described in Figure 7. In this configuration, measurements are achieved at the SCL level. It uses elements already present in the SCL for implementing eye-tracking and pupilometer measurements. It includes a laser that emits light towards the retina, combined with a photodiode embedded in the cavity. The measurement is based on laser feedback interferometry [24]. Basically, some of the reflected light is injected into the cavity. The laser field inside the cavity and the back-injected laser field will be in phase or out of phase, thus modulating the output power via self-mixing interference. If a small fraction of the modulated output power is measured by the photodiode, the phase difference between the beams and thus the eye length can be calculated. This value is then digitized and transmitted via a data link.

<figure><img src="image_10.png" /><figcaption>**Figure 7.** Refractive error measurement by self-mixing interferometry.</figcaption></figure>

In the second of the possible configurations, the laser is combined with a diffractive optical element (DOE) to create one or two spots on the retina. The light reflected from these two spots will create an interference pattern that can be detected by quadratic sensors located around the eye (Figure 8). These detectors are placed around the eye on the eyewear to keep the direction of sight free. In this case, knowledge of the gaze direction will help in compensating for the variable alignment of the eye with the detector.

In this configuration, measurements are achieved at the eyewear level, similar to the gaze direction solution. Hence, some elements or building blocks could be shared between the AF, the PD and the GD.

Since we demonstrated [17] that we could send a collimated beam towards the retina, a third option based on beam deviation might be theoretically possible, but the fact that we want to leave the pupil free imposes too many constraints in terms of possible beam paths to make it useful.

In both cases, laser feedback interferometry (Figure 7) or “classic” interferometry (Figure 8), we propose to use retinal reflection rather than reflections on the crystalline lens surfaces for several reasons. First, the amount of light reflected by the retina will be higher, and the use of interferometry from retinal reflections is a proven technique. Secondly, knowledge of the refractive error can be useful for other applications. Wearing glasses can interfere with the use of many instruments (sighting scope, microscope, augmented reality glasses, virtual reality headset, etc.). If one of these instruments were to incorporate an AF,
its optics could be automatically adjusted to the view of each subject, thus allowing them
to have a perfect image without wearing corrective glasses.

<figure><img src="image_11.png" /><figcaption>Figure 8. Refractive error measurement by interferometric method.</figcaption></figure>

3. Combination of All Sensors in the Same SCL

Except for the differences that arise when the computing task is implemented (inside or outside the SCL), the three functions contain common elements, such as the VCSEL and the antenna harvesting system. Indeed, our SCL eye-tracker can be easily merged with the pupilometer, by implementing a second VCSEL and its optics pointing outside the SCL, to determine the direction of gaze [15–17]. Similarly, the suggested SCL refractometer configuration requires the direction of sight be known, and is thus benefited by merging with the laser pointer SCL. Knowledge of the gaze direction of both eyes enables the convergence value to be derived. This information can be efficiently correlated with the accommodation measurements [21].

Furthermore, gaze direction knowledge of each eye permits convergence value de-
termination. The accommodation reflex is the visual response enacted when focusing on
nearby objects [21]. Considering that such mechanisms interact normally in a synkinetic
way, which consists of the convergence of both eyes, the contraction of the ciliary muscle
(accommodation) and pupillary constriction, the measured data are better analyzed correl-
atively in order to eliminate possible outliers. Alternatively, this approach could also be
useful to better determining where the user's attention is focused when they are exposed to
a convergence accommodation conflict (e.g., with 3D). Besides this, each functional design
requires at least one laser; these lasers do not need to be activated at the same time, but
must be time-multiplexed to reduce the energy consumption, as detailed later on.

With respect to the encapsulation constraint issue, two main parameters should be
considered in order to correctly engineer these functions in the same SCL. For all of them,
the volume constraint is the most important and prohibitive. The energy consumption
should also be considered for many reasons. Even if batteries can be incorporated into the
SCL [22], the simplest way to harvest the SCL remains energy transfer by magnetic coupling,
which should respect some of the limitations related to ocular safety and SCL heating.

Furthermore, the criteria are not independent, and can interfere (e.g., embedding a
battery will reduce the volume available for other circuits). This point will be discussed in
the next section with respect to the alternative implementation, regarding the two parallel
computing options.

3.1. *Proposed Multimodal Oculometric Sensors*

In this section, we discuss how an SCL including the three oculometric sensors can be
designed according to the two implementation strategies: including or not including data
computation at the SLC level. A hydride solution, mixing both strategies, remains possible.
### 3.1.1. Autonomous Sensor (On-Lens Computing)

On-lens computing can be implemented using a low-power integrated circuit (IC) comprising the necessary blocks required to monitor the sensors (e.g., photodiode and/or interferometer), activate the VCSEL, compute the metrics, transmit the metrics to the eyewear via an NFC link (see [15]), and finally harvest energy. Off-the-self ICs comprising all the necessary blocks exist. For instance, the NHS3152 from NXP is an NFC-powered IC dedicated to use in smart autonomous sensors. The IC includes a low-power Cortex-M0+ microcontroller, various data converters including a current-to-digital converter (I2D), and a near-field communication and energy-harvester block (power management unit, PMU). Analog and digital ports are also available to connect sensors and actuators. Specific digital pads on the NHS3152 can source up to 20 mA, more than enough to supply the VCSEL. The IC also has I²C and SPI ports to connect smart sensors. The microcontroller can implement a finite-state machine to sequence the lens operation (control the on/off VCSELs (Lasermate VCC-85C10G), measure the photocurrent of the infrared photodiode (Vishay T1170P) to determine the pupil diameter, and communicate with the eyewear or the headset). The NHS3152 consumes about 150 µA under a 1.8 V supply when clocked at 250 kHz, which is fast enough for our application. The 850 nm VCSELs have a threshold current of 0.5 mA. At 850 nm, the relative sensitivity of the T1170P photodiode is 0.95. Figure 9 shows a simplified block diagram of one possible implementation of the multimodal SCL; the supply voltage biasing the photodiode and the VCSELs is provided by the energy harvester. To limit power consumption, the VCSELs are sequentially turned on or off, with a low-frequency (~1 Hz) low duty cycle (<10%) control signal. The VCNL36825T proximity sensor used as a refractometer provides the digitized value of the measured photocurrent, and consumes 100 µA. The dimensions of all the elements are compatible with encapsulation into an SCL as shown in Figure 10. Table 1 gives the dimensions of each part; as seen, the thickest parts, the NHS3152 and the proximity sensor, are only 0.5 mm thick.

<figure><img src="image_12.png" /><figcaption>**Figure 9.** SCL simplified block diagram with the three functions for on-lens computation, built around the NHS3152 smart sensor IC from NXP.</figcaption></figure>

<table><caption>**Table 1.** Multimodal SCL parts' description.</caption><thead><tr><td>Function</td><td>Part</td><td>Manufacturer</td><td>W (mm)</td><td>L (mm)</td><td>H (mm)</td></tr></thead><tbody><tr><td>Integrated circuit</td><td>NHS3152 (WLCSP25)</td><td>NXP Semiconductor, Eindhoven, The Netherlands</td><td>2.51</td><td>2.51</td><td>0.5</td></tr><tr><td>Photodiode</td><td>T1170P</td><td>Vishay, Malvern, PA, USA</td><td>1.17</td><td>1.17</td><td>0.28</td></tr><tr><td>850 nm VCSEL</td><td>VCC-85C10G</td><td>Lasermate Group, Walnut, CA, USA</td><td>0.25</td><td>0.25</td><td>0.15</td></tr><tr><td>Proximity sensor</td><td>VCNL36825T</td><td>Vishay Semiconductor, Malvern, PA, USA</td><td>2</td><td>1.25</td><td>0.5</td></tr></tbody></table>
<figure><img src="image_13.png" /><figcaption>**Figure 10.** Implementation of the three functions of the block diagram of Figure 9 (VCC-85C10G: VCSEL; T1170P: photodiode; VCNL36825: proximity sensor as refractometer; NHS3152: smart sensor IC).</figcaption></figure>

A recent device, proposed by TRUMPF Photonic Components, integrates along a VCSEL (emitting at 850 nm) a photodiode to exploit the principle of self-mixing interference (SMI), allowing the accurate measurement of various parameters, including distances [23]. The 165 × 165 µm² three-pin chip can be connected to the I2D converter using another analogue port of the NHS3152 to measure the photodiode current, thus simplifying the overall design. The small size and low consumption of this device make it compatible with our SCL designs.

A possible implementation on a flexible substrate of the circuit of Figure 10 is shown in Figure 9.

### 3.1.2. Remote Computing (Off-Lens Computing)

In this version of the three-function instrumented SCL, none of the metrics are computed in the SCL to simplify the design and fabrication of the encapsulated electronics. Three VCSELs are required: one directed towards the headset as a pointer, and the two others pointing towards the eye, one to form the refractometer, and the other to measure the pupil diameter. As seen in Figure 11, the required electricity need only power the VCSELs and sequence the ON/OFF state of the VCSELs in order to perform the measurements, as was done in [17]. One possible implementation is on a flexible substrate of the circuit shown Figure 12.

<figure><img src="image_14.png" /><figcaption>**Figure 11.** SCL simplified block diagram with the three functions for remote computation.</figcaption></figure>

<figure><img src="image_15.png" /><figcaption>**Figure 12.** Option with remote computation (VCC-85C10G: VCSEL).</figcaption></figure>
## 3.2. Importance of the Addition of DOE

For the second option, the use of optics relays is, in most of the cases, required. As already shown in [20] and suggested in [19], DOEs are used either to collimate or to focus the VCSEL beam when using, for instance, an external detector, which is placed at a given distance from the eye, or to project a pattern at a given distance in front of the eye or on the retina. The DOEs are multi-phase level elements [24], etched into a layer (thickness ~1.8 µm) of spin-coated S1813 photoresist (MicroChem) on 175 µm-thick borosilicate glass substrates using a large custom-built parallel-writing photoplotter [25,26]. Typical DOE diffraction efficiencies of 70-75% are generally observed. The DOE size is determined by the laser beam divergence and the VCSEL to DOE distance, the encapsulation constraint of which is limited to less than 1 mm. Considering our VCSEL divergence (8°) and a distance to the DOE of 680 µm (to limit the lens thickness), the usable surface will be around 200 × 200 µm², as the spot's diameter is 200 µm. Here, the size of the DOE is 225 × 225 µm² (Figure 13). Only one is observable on this Figure, but a DOE array with four facets, as shown Figure 4, will be easily implemented using this technique. Figure 13 shows the different steps of the integration of the DOE in the SCL, derived from [20].

<figure><img src="image_16.png" /><figcaption>**Figure 13.** (a) DOE of dimensions 225 × 225 µm² on a glass square of 1.2 × 1.2 mm², (b) mounted on the VCSEL, (c) encapsulated in the SCL [20].</figcaption></figure>

Compared to the on-lens computing case, this option assumes better knowledge of the eye movements in order to provide accurate and reliable oculometric data. Even if the eye motions are in practice limited within a solid angle of less than 15°, the data processing of the various measurements obtained from the different sensor sources by using, for instance, deep learning techniques (including, for instance, knowledge of eye motion common trajectories and saccades) would be useful to make our system more robust.

## 4. Discussion

Based on our encapsulation experience and anticipating future nanotechnology advances, we have proposed and discussed two modes of implementing the three functions in a unique SCL. Such an alternative illustrates the two main methods of using an SCL interfaced with an IVAS. The first one has the advantage of guaranteeing complete mobility, and the capacity to be driven by various devices, such as a smartphone. In contrast, the second option requires a more dedicated monitoring device, such as AR headsets, with the advantage of more sophisticated data detection involving sensor arrays and extended data processing. This option represents the most promising way to use an SCL in combination with an IVAS, such as an AR headset, by using it as a visual cursor to designate commands in menus or targets in 3D scenes. Furthermore, it emphasizes the importance of using a DOE in SCL for many purposes. One of the most challenging, as described in [20], is to be able to directly project on the retina patterns or icons, independently from eye movements and blinking. This is the first step towards what we have called Perivoveal Retinal Augmented Reality (PRAR) [19], which anticipates the transfer of some AR headset display capabilities directly into the SCL, as envisioned for instance by Mojo-Vision [27]. Concerning our main objective, related to the combination in a single SCL of three oculomotor
sensors by mutualizing some common elements, we have demonstrated that it is possible
with respect to the current state of the art of the technology, and the specific volume and
energy constraints of the SCL. Beyond this technological challenge, there is a real benefit to
be derived from implementing these functions on the same platform (in particular, the eye
itself) considering the near-synkinetic reflex between accommodation, convergence and
mydriasis [21]. Furthermore, our multimodal SCL's ability to record and accommodate eye
orientation is nowadays crucial to analyzing mixed reality scenes, where accommodative
demand and convergence are often uncoupled. The presence of a gaze pointer in our SCL
detected with an IVAS, will solve common issues of alignment between the display and the
moving eye's pupil. It will enable the stimulation of any retinal location in a controlled way
(e.g., in shape, motion, and color), facilitating the establishing of cognitive correspondence.

**Author Contributions:** Conceptualization, J.-L.d.B.d.I.T. and V.N.; electronics, C.L.; writing—original draft preparation, all authors; writing—review and editing, all authors. All authors have read and agreed to the published version of the manuscript.

**Funding:** This research received no external funding.

**Institutional Review Board Statement:** Not applicable.

**Informed Consent Statement:** Not applicable.

**Data Availability Statement:** Not applicable.

**Conflicts of Interest:** The authors declare no conflict of interest.

**References**

1. Gambiraža, M.; Kesedžić, I.; Šarlija, M.; Popović, S.; Ćosić, K. Classification of Cognitive Load based on Oculometric Features. In Proceedings of the 44th International Convention on Information, Communication and Electronic Technology (MIPRO), Opatija, Croatia, 27 September–1 October 2021. [CrossRef]

2. Massin, L.; Seguin, F.; Nourrit, V.; Daniel, E.; de Bougrenet de la Tocnaye, J.-L.; Lahuec, C. Multipurpose Bio-Monitored Integrated Circuit in a Contact Lens Eye-Tracker. *Sensors* **2022**, *22*, 595. [CrossRef]

3. Morimoto, C.H.; Mimica, M.R.M. Eye gaze tracking techniques for interactive applications. *Comput. Vis. Image Underst.* **2005**, *98*, 4–24. [CrossRef]

4. Xia, Y.; Khamis, M.; Anibal Fernandez, F.; Heidari, H.; Butt, H.; Ahmed, Z.; Wilkinson, T.; Ghannam, R. State-of-the-Art in Smart Contact Lenses for Human Machine Interaction, Electronics. *arXiv* **2021**, arXiv:2112.10905.

5. Truththeory. Available online: https://truththeory.com/sonys-new-blink-powered-contact-lens-records-everything-see/ (accessed on 1 May 2022).

6. Interesting Engineering. Available online: https://interestingengineering.com/new-scientific-invention-contact-lens-that-zoom-in-the-blink-of-an-eye (accessed on 1 May 2022).

7. Lech, M.; Andrzej Czyzewski, A.; Kucewicz, M.T. CyberEye: New Eye-Tracking Interfaces for Assessment and Modulation of Cognitive Functions beyond the Brain. *Sensors* **2021**, *21*, 7605. [CrossRef] [PubMed]

8. Jacob, R.J.K. What you look at is what you get: Eye movement-based interaction techniques. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '90, Seattle, WA, USA, 1–5 April 1990; pp. 11–18.

9. Majaranta, P.; Räihä, K.-J. Twenty years of eye typing: Systems and design issues. In Proceedings of the 2002 Symposium on Eye Tracking Research & Applications, ETRA '02, New Orleans, LA, USA, 25–27 March 2002; pp. 15–22.

10. Drouot, M.; Le Bigot, N.; Bricard, E.; de Bougrenet de la Tocnaye, J.-L.; Nourrit, V. Augmented reality on industrial assembly line: Impact on effectiveness and mental workload. *Appl. Ergon.* **2022**, *103*, 103793. [CrossRef]

11. Kawala-Sterniuk, A.; Browarska, N.; Al-Bakri, A.; Pelc, M.; Zygarlicki, J.; Sidikova, M.; Martinek, R.; Gorzelanczyk, E.J. Summary of over Fifty Years with Brain-Computer Interfaces A Review. *Brain Sci.* **2021**, *11*, 43. [CrossRef] [PubMed]

12. Katona, J. Analyse the Readability of LINQ Code using an Eye-Tracking-based Evaluation. *Acta Polytech. Hung.* **2021**, *18*, 193–215. [CrossRef]

13. Glover, S.; Wall, M.B.; Smith, A.T. Distinct cortical networks support the planning and online control of reaching-to-grasp in humans. *Eur. J. Neurosci.* **2012**, *35*, 909–915. [CrossRef] [PubMed]

14. Katona, J. A Review of Human-Computer Interaction and Virtual Reality Research Fields in Cognitive InfoCommunications. *Appl. Sci.* **2021**, *11*, 2646. [CrossRef]

15. Khaldi, A.; Daniel, E.; Massin, L.; Kärnfelt, C.; Ferranti, F.; Lahuec, C.; Seguin, F.; Nourrit, V.; de Bougrenet de la Tocnaye, J.-L. The cyclops contact lens: A laser emitting contact lens for eye tracking. *Sci. Rep.* **2020**, *10*, 14804. [CrossRef] [PubMed]

16. Massin, L.; Nourrit, V.; Lahuec, C.; Seguin, F.; Adam, L.; Daniel, E.; de Bougrenet de la Tocnaye, J.-L. Development of a new scleral contact lens with encapsulated photodetectors for eye tracking. *Opt. Express* **2020**, *28*, 28635–28647. [CrossRef] [PubMed]
17. Robert, F.M.; Adam, L.; Nourrit, V.; de Bougrenet de la Tocnaye, J.-L. Contact lens double laser pointer for combined gaze tracking and target designation. *PLoS ONE* **2022**, *17*, e0267393. [CrossRef] [PubMed]

18. Regal, S.; Troughton, J.; Djenizian, T.; Ramuz, M. Biomimetic models of the human eye, and their applications. *Nanotechnology* **2021**, *32*, 302001. [CrossRef] [PubMed]

19. Nourrit, V.; Pigeon, Y.E.; Heggarty, K.; de Bougrenet de la Tocnaye, J.-L. Perifoveal Retinal Augmented Reality (PRAR) on contact lenses. *Opt. Eng.* **2021**, *60*, 115103. [CrossRef]

20. Robert, F.M.; Coppin, G.; Nourrit, V.; de Bougrenet Bougrenet de la Tocnaye, J.-L. Smart contact lenses for visual human machine interactions. In *Proceedings of the 10th Visual and Physiological Optics Meeting (VPO 2022)*, Cambridge, UK, 29–31 August 2022.

21. Khurana, A.K. Asthenopia, anomalies of accommodation and convergence. In *Theory and Practice of Optics and Refraction*, 2nd ed.; Elsevier: Amsterdam, The Netherlands, 2008; pp. 98–99. ISBN 978-81-312-1132-8.

22. Nasreldin, M.; Delattre, R.; Calmes, C.; Sugiawati, V.; Maria, S.; de Bougrenet Bougrenet de la Tocnaye, J.-L.; Djenizian, T. High Performance Stretchable Li-ion Microbattery. *Energy Storage Mater.* **2020**, *33*, 108–115. [CrossRef]

23. Moench, H.; Bader, S.; Gudde, R.; Hellmig, J.; Moser, D.; Ott, A.; Spruit, H.; Weichmann, U.; Weidenfeld, S. ViP-VCSEL with integrated photodiode and new applications. In *Vertical-Cavity Surface-Emitting Lasers XXVI*; SPIE: Bellingham, WA, USA, 2022; Volume 1202006. [CrossRef]

24. Kress, B.C.; Meyrueis, P. *Applied Digital Optics: From Micro-Optics to Nanophotonics*; Wiley: Hoboken, NJ, USA, 2009; Chapter 6, ISBN 978-0-470-0226.

25. Wyrowski, F. Iterative quantization of digital amplitude holograms. *Appl. Opt.* **1989**, *28*, 3864–3870. [CrossRef] [PubMed]

26. Kessels, M.M.; Bouz, M.E.; Pagan, R.; Heggarty, K. Versatile stepper based maskless microlithography using a liquid crystal display for direct write of binary and multilevel microstructures. *J. Micro/Nanolithogr. MEMS MOEMS* **2007**, *6*, 033002. [CrossRef]

27. Perry, T.S. Mojo Vision Puts Its AR Contact Lens Into Its CEO's Eyes (Literally). The Augmented Reality Contact Lens Reaches a Major Milestone, *IEEE Spectrum*. 2022. Available online: https://spectrum.ieee.org/looking-through-mojo-visions-newest-ar-contact-lens (accessed on 1 May 2022).