Patent ID: 11862145
Assignee: BEHAVIORAL SIGNAL TECHNOLOGIES, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A method for processing multi-modal input comprising:
receiving a plurality of signal inputs, each signal input having a corresponding input mode;
processing each signal input in a series of mode-specific processing stages,
each successive mode-specific processing stage being associated with and performing processing at a successively longer scale of analysis of the signal input of the corresponding input mode; and

generating a fused output based on the output of a series of fused processing stages,
each successive fused processing stage being associated with and performing processing at a successively longer scale of analysis of the signal input;

wherein multiple fused processing stages receive inputs from corresponding mode-specific processing stages corresponding to different input modes, whereby the fused output depends on the plurality of signal inputs;
wherein the series of mode-specific processing stages include:
a first processing stage for a first input mode,
a second processing stage for the first input mode,
a first processing stage for a second input mode, and
a second processing stage for the second input mode; and

wherein the series of fused processing stages include:
a first fused processing stage, and
a second fused processing stage; and

wherein:
the first fused processing stage receives input from the first processing stage for the first input mode via a first output of said stage for the first input mode and from the first processing stage for the second input mode via a first output of said stage for the second input mode,
the second processing stage for the first input mode receives input from the first processing stage for the first input mode via a second output of said stage,
the second processing stage for the second input mode receives input from the first processing stage for the second input mode via a second output of said stage, and
the second fused processing stage receives input from the second processing stage for the first input mode and from the second processing stage for the second input mode.