Patent application EP17170492A (EP), filed 2017-05-10
Publication number: EP3372467A1
Title: METHOD AND SYSTEM FOR HISTORICAL STATE BASED ADVANCED DRIVER ASSISTANCE
Abstract: The present invention provides a method and system of historical emotion based driver advanced assistance. In this method, a combination of external environment to a vehicle on which the advanced driver assistance system (ADAS) is mounted fetched by forward looking cameras is combined with rear looking camera for internal environment or driver state, is generated. The generated combination is utilized to analyze is there is any critical situation that is upcoming. For providing feedback for such situation, the ADAS fetches a historical combination situation similar to the current situation combination. The intensity of the feedback is varied as per the driver reaction to the feedback provided to the driver at such historical combination situation.
IPC codes: G01S  17/    86            A I
G01S  17/   931            A I
H04N  23/    90            A I
B60W  30/   095            A I
B60W  50/    00            A I
B60W  50/    14            A I
Claims: number: 1
text: An advanced driver assistance system mounted on a vehicle, wherein the system comprises;
a forward looking first camera, adapted to identify activity and objects in short-range vicinity of the vehicle;
a forward looking second camera, adapted to identify activity and objects in long-range vicinity of the vehicle;
a ranging module, adapted to measure distance to objects in a straight path;
a rear looking third camera, wherein the third camera is configured to monitor driver state;
a storage, configured to store driver profile and reaction to driving situations
a processor, configured to receive inputs from the first camera, the second camera, the ranging module, the third camera, and the storage, and wherein the processor is further configured to provide a feedback to the driver for a real-time situation, wherein the intensity of the feedback to the user is varied based on the historical reaction of the driver to a feedback to a historical situation similar to the real-time situation.
number: 2
text: The system of claim 1, wherein the first camera is a stereo camera having a short focal length.
number: 3
text: The system of claim 1, wherein the second camera is a long range narrow field camera having a long focal length.
number: 4
text: The system of claim 1, wherein the ranging module is a is a light detection and ranging (LiDAR) unit.
number: 5
text: The system of claim 1, wherein the third camera is a charge coupled device camera.
number: 6
text: The system of claim 1, wherein the third camera monitors driver state by capturing eye gaze and facial expressions of the driver.
number: 7
text: The system of claim 1, wherein the historical reaction includes anyone or a combination of intensity of reaction, time to braking, or facial expressions during reaction.
number: 8
text: The system of claim 1, wherein the feedback is any one or a combination of an audio feedback, a visual feedback, or a haptic feedback.
number: 9
text: The system of claim 1, wherein the intensity of feedback is a mild, a moderate or a severe.
number: 10
text: A real-time driver assistance method, comprising;
gathering current external environment information through a plurality of forward looking cameras connected to a processor;
capturing current driver state information through at least one rear looking camera, connected to the processor;
generating, by the processor a combination of the current external environment and the current driver state information;
fetching, by the processor, a historical combination similar to the combination generated by the processor from a storage module, wherein the storage module is configured to store a plurality of historical combinations of external environment and corresponding driver state data and a corresponding driver reaction to a feedback offered to the driver for a particular combination of external environment and driver state during the particular combination; and
varying, by the processor, intensity of a feedback to be provided to the driver wherein the variation is based on the similar historical combination and the corresponding driver reaction.
number: 11
text: The real-time driver assistance method of claim 10, wherein the plurality of forward looking cameras include anyone or a combination of a stereo camera, or a long range narrow field camera.
number: 12
text: The real-time driver assistance method of claim 11, wherein profile of the driver is stored in the external environment captured using the at least one rear looking camera.
number: 13
text: The real-time driver assistance method of claim 12, wherein the driver profile includes data like age bracket, sex, or general emotional state while driving.
number: 14
text: The real-time driver assistance method of claim 13, wherein the processor also combines the driver profile along with the historical reaction to the similar historical combination.
Office action: search_report, dated 2018-09-12
Rejection reasons: novelty_epc_54
inventive_step_epc_56
Prior art cited: ref_id: GB2528084A
ref_type: patent
severity: background
ref_id: US5172235A
ref_type: patent
severity: background
ref_id: - C�LINE CRAYE AND FAKHRI KARRAY: "Driver distraction detection and recognition using RGB-D sensor", 1 February 2015 (2015-02-01), XP002773288, Retrieved from the Internet <URL:https://arxiv.org/pdf/1502.00250.pdf> [retrieved on 20170829]
ref_type: npl
severity: background
ref_id: US5172235
ref_type: patent
severity: obviousness
ref_id: GB2528084
ref_type: patent
severity: novelty_destroying
ref_id: - C�line Craye and Fakhri Karray, "Driver distraction detection and recognition using RGB-D sensor", (20150201), URL: https://arxiv.org/pdf/1502.00250.pdf, (20170829), XP002773288 [Y] 6 * abstract *
ref_type: npl
severity: obviousness
Final disposition: pending (2018-09-12)