Patent ID: 11972616
Assignee: GOOGLE LLC
Field: Measurement (Instruments)
Classification: CPC G | IPC G

Claim 16:
17. A system comprising:
memory configured to store at least one of instructions or data; and
one or more processors operatively coupled to the memory, the one or more processors being configured to:
receive real-time imagery obtained by a camera located in a vehicle during driving of the vehicle by a driver;
receive real-time non-verbal audio input obtained by a microphone located in the vehicle during driving
analyze, in real-time, at least one image from the real-time imagery and the real-time non-verbal audio input to determine a current condition in an external environment around the vehicle;
determine, in real-time after the analysis and based on the real-time imagery and the real-time non-verbal audio input, that the current condition is expected to at least partially obscure a selected landmark in the external environment from viewing by the driver;

upon determining that the current condition is expected to at least partially obscure the selected landmark in the external environment from viewing by the driver, identify, in real-time based on the real-time imagery, a different landmark that is currently observable by the camera located in the vehicle, the identifying comprising selecting the different landmark from the real-time imagery;
determine a likelihood that the driver will correctly follow navigation instructions based on the current condition; and
provide a visual, audible or haptic indication of the different landmark to the driver, wherein the visual, audible, or haptic indication is augmented with additional cues when it is determined that the driver is not likely to correctly follow the navigation instructions.