Patent ID: 11955029
Assignee: nan
Field: Measurement (Instruments)
Classification: CPC G | IPC G

Claim 0:
1. A system for providing indoor situational awareness and navigational aid for the visually impaired user, wherein the system comprising:
a motion sensor configured to detect motion of a user;
an image sensor configured to capture an image of the scene, in front of the user;
a compass;
a depth sensor, wherein the depth sensor is configured to provide the depth information;
a processor; and
a memory, wherein the processor is configured to execute instructions stored in the memory for;
receiving, input data provided by the motion sensor, the image sensor, the compass, and the depth sensor;
enhancing, the image captured by the image sensor based upon the angle and the depth information provided by the depth sensor;
determining, “directional saliency”, “saliency at rest” and “saliency in motion” of the enhanced image of the scene to provide situational awareness, wherein situational awareness at least includes the depth or distance information and a directional orientation;
generating, a virtual graph with a grid of nodes equidistant from each other within the enhanced image of the scene;
probing each node of the grid of nodes in order to check whether or not the point corresponding to said node is on a floor;
determining, the shortest path to a destination in the virtual graph by only considering the points on a floor; and
converting, the description of the shortest path and the scene into one or more of audio or Braille text instruction to the user, wherein the description is enhanced with the distance information and directional orientation and ordered by “directional saliency”, “saliency at rest” or “saliency in motion”.