ANGEL NAVIGATION“Give a blind person a pair of eyes”

You Are My Eyes TeamBackgroundAlgorithms

According to data from the World Health Organization (WHO), as of 2020, approximately 285
million people worldwide were affected by varying degrees of visual impairment, of whichapproximately 36 million were completely blind. Blind navigation can improve the quality of life,autonomy, and safety of visually impaired individuals, enabling them to better integrate into
society and participate in various activities.

1. Image Recognition Algorithm: When the blind person approaches the bus stop sign, therecognition algorithm can identify the destination of the detected bus.
Merging
PatchEmbedding

Mixing Blocks

Bus StopMerging

Merging

FCTowards

Mixing Blocks

Mixing Blocks

Magic CentreConcept
2. Target Detection Algorithm: When a vehicle enters the bus stop, the detection algorithms canbe used to identify whether the current vehicle is a bus.

To help visually impaired people live better, we have designed smart
glasses that use UC-winRoad software to simulate a blind person's
perspective and convey details about the journey, such as the use oftransportation, taking buses, visiting parks, etc. The visual content will
be processed with an algorithm before it is reported via voice.

BuInput
Image

C.R

C.R

C.R

C.R

FC.R

FC

Reshapes

7×7×30

System Architecture
Web Page Display

The Bus Is Coming.

3. Scene Semantic Understanding Algorithm: After entering the park, blind people will be assistedby this algorithm in sightseeing, and when encountering different entertainment facilities orpublic toilets, they will be told which direction they are in through voice broadcasting.

Image Recognition Algorithm···

3D Scene Construction

Algorithm DevelopmentMapping
NetworkRecognition Result

Target Detection Algorithm
Scene Semantic
Understanding Algorithm

Bus Detected.

Voice
Announcements
Archive
Database···Caption Tokens
Ahead is the slide, and further ahead is theFerris wheel.

System Visualization Display
And Voice BroadcastingAngel Navigation

We use UC-win/Road's first perspective to simulate the content captured by glasses, including
scenes of bus stops, on buses, and park lights. Different types of algorithms were applied on
captured data. Different types of algorithms were applied to captured data for various purposes.
We use image comprehension algorithms to take screenshots of the images from the perspective
for understanding over time. Including scenes of bus stops, buses, and park lights. For example,
the bus stop signs will tell blind people which bus route to take, determine whether the bus hasarrived, and if so, tell the blind person that the bus has arrived. The detection algorithms are usedto identify traffic lights and return whether the light in front of the blind person is red or green.

You entered the bus stop. Please check the route of the bus forward.
The station sign is in front of you on your left.
The light is red please stop.
Green light, we can go.

The current bus route is N15.

Future Improvements

There is a public restroom ahead.

Prefix Embeddings••••

Improve the speed and accuracy of the algorithm.
Optimize voice broadcast to make it sound more comfortable.
Add some emergency situations for blind people.
Optimize the model to look more realistic.