Patent ID: 11960644
Assignee: ROCKWELL COLLINS, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G  B | IPC B  G

Claim 0:
1. A system for inferring operator intent by detecting operator focus, the system comprising:
one or more cameras positioned within a control space of a mobile platform, the control space comprising one or more interfaces, the one or more cameras oriented toward a control position within the control space and configured to capture at least one image corresponding to:
a gaze of an operator occupying the control position;
or
a body pose of the operator, the body pose comprising at least one of a position or an orientation of at least one body part of the operator;
a memory configured for storage of one or more target poses, each target pose associated with at least one of a position or an orientation of the one or more interfaces, each target pose relative to the one or more cameras;
and
one or more processors in communication with the one or more cameras and the memory, the one or more processors configured to:
receive the at least one image;
detect, based on the at least one image, at least one of the gaze or the body pose;
train the memory using training data corresponding to one or more observed parameters based on the detected gaze or the body pose;
and
based on the detected gaze or body pose and the one or more target poses, infer at least one future focus target of the operator, the future focus target comprising at least one of:
a future target of the gaze of the operator;
or
an interface associated with a future engagement by the operator,

wherein the one or more processors are configured to determine a confidence level corresponding to each future focus target.