Title: A wearable smart visual aid for central vision loss
Funder: Department of Health and Social Care

Abstract: Software Milestone 1: Display Calibration tool We will design and implement a visual assessment tools on the targeted displays to measure the wearer's visual acuity and contrast sensitivity. This tool will be the basis for customising the enhancement algorithms variables to an individual's visual characteristics. Deliverable will be in month 3. Software Milestone 2: Image Stabilisation Results from our previous work with the Smart Glasses has indicated the difficulty some users had with the limited field of view (23deg). The head mounted camera can difficult to control when high magnification is used, we will implement image stabilisation techniques, face detection and text detection to assist the wearer hold the target object in the displays view. Deliverable in month 5. Software Milestone 3: Algorithm implementation and optimisation for face / emotion recognition Several proven image enhancement techniques exist to aid with face and emotion recognition for individuals those with central vision loss, such as E. Peli et al. 1994 and J. Irons et al. 2014. We will implement, optimise and enhance these existing approaches. Face detection techniques will be used to aid foreground/background segmentation of faces. Work for this has already begun, with an implementation on the existing Smart Glasses. Deliverable in month 8. Software Milestone 4: Algorithm implementation and optimisation for reading assistance. Text enhancements techniques such as contrast/colour enhancements and magnification will be implemented and optimised. Text detection will be used to aid the enhancements by segmenting text from non-text information in the visual scene. Pilot work for this has been performed, with an implemented on a mobile device, deliverable in month 11. Patient / Participant Trials Milestones Trial 1: Face / emotion recognition trial: commencing Month 12 Conducted at the Oxford Eye hospital, we will study the effects of the image enhancement algorithms on cohort of approximately 60 central vision loss sufferers, specifically age-related macular degeneration and Stargardt’s disease. Participants will have their vision clinically characterised by their acuity, visual field and contrast sensitivity. Deliverables are the effectiveness of the image enhancements and correlation to their vision characteristics. Trial 2: Reading, near and far trial: commencing Month 17 We will study the effects of magnification and image enhancement techniques for assisting reading in near and far cases on approximately 60 central vision loss sufferers. Individuals will be assessed by standard ophthalmic reading acuity measurements, speed and accuracy. Image stabilisation will be assessed as a tool to aid the user maintain the text in their field of view. Deliverables are the effectiveness of the employed techniques, accuracy and speed of reading. Display calibration and customisation During Trials 1 and 2 we will also examine performance increases that arise from display customisations. Image stabilisation, display calibration and variations to the display’s field of view will be assessed relative to participant performance on face/emotion recognition and reading tasks.

Lay abstract: Blindness robs over 300,000 people in the UK of much of their independence and quality of life. Over the past four years we have developed and validated a highly successful platform of smart glasses that dramatically increase a person's ability to see and recognise faces and regain much of that lost independence and self confidence in challenging real-world situations. Our device - supported by two previous NIHR i4i grants - uses a unique camera, bespoke software and cutting-edge display technologies to provide a simplified and enhanced view of the outside world. Our software is able to rapidly identify and enhance objects that are of importance to an individual, such obstacles and faces. Our system generates a high-contrast image which is presented on the inside of see-through displays, providing a real-time increase in situational awareness and vision, while allowing the user to see the world as they normally would. We have recently completed a large UK-wide investigation of these smart glasses. The results have been profound, with over half of all participants reporting remarkable success stories such as better connections with friends and family through improved face recognition, or the confidence to take part in social activities and independent travel. While the glasses in their current form worked well for conditions like retinitis pigmentosa, we were unable to provide benefit to more than 10% of people with central vision loss, such as age-related macular degeneration, due to the smart glasses small and highly-detailed displays. In this application we propose to address this by developing novel software solutions that make use of the latest head-mounted displays, and validate these technologies with extensive testing of individuals with AMD. The results of this project will be commercialised through our new company to bring the benefits of smart glasses to a much wider UK audience.

Research activity codes: 7.1 INDIVIDUAL CARE NEEDS
Health categories: EYE