Patent application EP22176709A (EP), filed 2022-06-01
Publication number: EP4099278A1
Title: DETECTING ANOMALOUS BEHAVIORS WITHIN AIRCRAFT CONTEXT
Abstract: [0001]    A pilot may be more stressed during take-off or landing, which is not abnormal. Physiological data of the pilot may be received. Placing the physiological data in context of the current situation may be advantageous in detecting anomalous behaviors of the pilot. A system (100) and method (200) are described. The system and method receive (210) a stream of images from a camera and detect whether the pilot is exhibiting anomalous behavior. The anomalous behavior is further put into context based on the flight state and various avionics information.
IPC codes: G06V  10/    80            A I
G06V  20/    59            A I
Claims: number: 1
text: A system (100) comprising:
number: 2
text: The system of claim 1, wherein the pilot state includes at least one of a fatigue or a stress of the pilot.
number: 3
text: The system of claim 1 or 2, wherein the flight state of the aircraft includes at least one of takeoff, climb, cruise, descent, or landing.
number: 4
text: The system of any preceding claim, wherein the avionics information of the aircraft includes traffic alert and collision avoidance information.
number: 5
text: The system of any preceding claim, wherein the one or more processors are further configured to receive a pilot interaction (108) with the aircraft; wherein the one or more processors determine the flight context for the aircraft based on the avionics information, the flight state, and the pilot interaction.
number: 6
text: The system of claim 5, wherein the pilot interaction includes at least one of a heart rate or an electrocardiogram of the pilot.
number: 7
text: The system of any preceding claim, wherein the one or more processors are configured to use at least two behavior classifiers for classifying the behavior of the pilot; wherein determining the probability distribution for the behavior further includes performing conflict resolution (124) when a first behavior classifier of the at least two behavior classifiers classifies the pilot as having a first behavior and a second behavior classifier of the at least two behavior classifiers classifies the pilot as having a second behavior.
number: 8
text: The system of claim 7, wherein the conflict resolution includes weighting the first behavior classifier and the second behavior classifier based on the flight context.
number: 9
text: The system of claim 7 or 8, wherein at least one of the at least two anomaly detection classifiers is an unsupervised machine learning algorithm.
number: 10
text: The system of claim 9, wherein the one or more processors are configured to train the unsupervised machine learning algorithm for each pilot of the aircraft.
number: 11
text: The system of any preceding claim, wherein the one or more processors are configured to receive the stream of images, the avionics information of the aircraft, and the flight state of the aircraft; wherein the one or more processors are configured to classify the current flight context for the aircraft based on the avionics information and the flight state.
number: 12
text: The system of any preceding claim, wherein the non-transitory memory maintains previous behaviors and previous contexts associated with the previous behaviors; wherein the one or more processors are configured to classify the current flight context for the aircraft based on the avionics information, the flight state, and the previous contexts associated with the previous behaviors.
number: 13
text: The system of claim 12, wherein the previous behaviors and the previous contexts are associated with the pilot; wherein the one or more processors are further configured to store the behavior of the pilot and the current flight context of the aircraft in the non-transitory memory.
number: 14
text: The system of any preceding claim, wherein the non-transitory memory and the one or more processors are housed in a common housing.
number: 15
text: A method (2000 comprising:
Office action: search_report, dated 2022-12-07
Rejection reasons: novelty_epc_54
inventive_step_epc_56
Prior art cited: ref_id: US2020242343A1
ref_type: patent
severity: background
ref_id: US2020000390A1
ref_type: patent
severity: background
ref_id: US2016009411A1
ref_type: patent
severity: background
ref_id: EP2434465A2
ref_type: patent
severity: background
ref_id: US2020322527A1
ref_type: patent
severity: background
ref_id: EP2434465
ref_type: patent
severity: novelty_destroying
ref_id: US2016009411
ref_type: patent
severity: novelty_destroying
ref_id: US2020000390
ref_type: patent
severity: obviousness
ref_id: US2020242343
ref_type: patent
severity: novelty_destroying
ref_id: US2020322527
ref_type: patent
severity: background
Final disposition: pending (2022-12-07)