EYE TRACKING CAMERA MOUSE FOR E-LEARNING SYSTEMS
Authors: Lupu Robert gabriel , Ungureanu Florina 
Published: February 2023

In the last decade, various technologies (like collaborative software, cloud computing, screencasting, ePortofolios, virtual classroom) and different devices (e.g. mobile devices, webcams, audio/video systems or smartboards) were used to facilitate e-learning development and to increase the effectiveness and accessibility of e-learning platforms. Some previous studies revealed that eye tracking methods can improve the functionality and usability of e-learning systems (http://e-tracking.unipv.it/, http://elearnmag.acm.org/, AdeLE project). Our research is concentrated on providing a reliable solution for people with neurolocomotor disabilities to access and use a distance learning system.
Many persons with neuromotor paralysis caused by strokes, accidents or surgery have a very good level of understanding and perception, follow a rehabilitation process and live with the hope to come back to social life. For these persons it is very important to continue their intellectual activity and learning. They could not stay comfortable in front of a computer, are not able to use any electronic devices, tablets or books. But, their mind is awaked, they can move their eyes and this can be useful for communication and information access.
In concordance with assistive technology initiative that aims to provide hardware and software solutions to help students to overcome a disability (http://www.e-learningfoundation.com/assistive-technology), the eye tracking research is experiencing exponential growth.
In this study we propose an eye tracking mouse (ETM) system using video glasses and a robust eye tracking algorithm for human computer interaction (HCI) allowing the patient to communicate his needs, to browse a graphical user interface and to select an image or a word, using only his eyes.
The webcam, attached to the video glasses captures images of patient's eyes. The video glasses display copies of the computer screen for both eyes so that the patient sees a 16:9 widescreen 1.9 m display, as seen from 3 m. The software application detects the pupil and maps its webcam position on computer screen in concordance with patient's gaze direction. Therefore, the mouse cursor is moved in the point of screen coordinates. By gazing at that point for one to two seconds, the software generates left click event. In this way the patient can point and click. The assessment of the proposed ETM reveals its robustness to ambient illumination conditions, patient's head position, noise generated by involuntary blinking or inherent pupil movement.
Therefore, ETM can be used as an alternative input device for accessing information on a computer associated with customisable software. Any patient may use this communication system for his basic needs, entertainment or could become a student by getting web-accessibility e-learning courses. A virtual on-screen keyboard typed by gaze and the word prediction software can help patients to participate to a remote dialog. The recorded data from ETM can reveal patients's emotions and interest level during dialog or e-learning platform access.
Our research is to discuss the integration of assistive technologies, particularly eye-tracking solutions in e-learning platforms and services for persons with disabilities and to assess the impact of such an approach on patients'life and education in the perspective of their future medical recovery.