Development of a Training Simulator and Testing Environment for Electric Wheelchair Controls
Authors: Bulk Jendrik , Tannert Benjamin 
Published: November 2024

A training simulator is being designed as part of the interdisciplinary research project “Development of alternative control systems for wheelchairs”. This simulator serves as a platform for testing and evaluating innovative control concepts that are created in an iterative process involving users with electric wheelchairs, medical and technical specialists. The development focuses on integrating the physical properties of a real, electric wheelchair into a simulation. This wheelchair is typically controlled with the hand, chin or tongue joystick and has characteristics such as inertia and acceleration behaviour. The goal is to create a driving experience that is as realistic as possible. These adjustments are continually developed in close cooperation with the groups mentioned. This project aims to clarify how the transfer of the real wheelchair into the virtual simulation affects the learning behaviour, motivation, and satisfaction of patients who complete training with electric wheelchairs.Interviews with occupational therapists at the Center for Paraplegics in Hamburg have revealed an increased need for such a training simulator. Currently, training with electric wheelchairs is limited to real-world environments, which poses certain risks. The home environment is simulated in the clinic with markings on the floor. A safer and more efficient training method would be to use a variable, virtual environment in which patients can be familiarized with the new method of locomotion without risk. For this purpose, realistic training scenarios from everyday clinical practice are integrated into the virtual environment of the training software. A virtual reality headset allows patients to adapt to using the electric wheelchair without risk and at their own pace. In cooperation with a leading manufacturer of electric wheelchairs, the plan is to use the physical hardware of the wheelchair as an interactive input device for the simulator. It will also be possible to configure the specific comfort settings (including backrest, headrest, largest, armrests) within the training simulation. In particular, the adjustability of the backrest is an important element of driving training for mastering slopes and slides.The next phase of research is concerned with the development of an eye-controlled digital joystick for the Magic Leap 2 augmented reality glasses, which will eventually also be implemented in real wheelchairs. The joystick is initially used as a control element for a virtual wheelchair in a simulated test environment. A key development goal is to visualize the wheelchair's user-specific user interface (UI) on the AR display. It is also planned to enable control of the UI via eye control and voice commands to ensure intuitive and barrier-free interaction. Thanks to flexible setting options, the UI can be personalized to the requirements of the respective user.After a comprehensive evaluation of the control by the test subjects and medical staff regarding user-friendliness and safety, the innovative control is integrated into a physical wheelchair. In a further iterative process, the control is continuously optimized in close collaboration with the end users in a protected setting.