Patent ID: 11862145
Assignee: BEHAVIORAL SIGNAL TECHNOLOGIES, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 12:
13. A multi-modal input processing system comprising:
a plurality of inputs, each input configured to receive an input signal of a plurality of input signals having a corresponding input mode of a plurality of input modes;
for each input mode of the plurality of input modes, a series of mode-specific processing stages,
each successive mode-specific processing stage being associated with and performing processing at a successively longer scale of analysis of the input signal of the corresponding input mode,
each mode-specific processing stage other than a first processing stage of said series being coupled to a prior processing stage of said series for receiving an output from said prior processing stage, and
the first processing stage of said series being coupled to the input and configured to receive the input signal of said input mode;

a series of fused processing stages including a final fused processing stage of the series of fused processing stages providing an output of the multi-modal input processing system,
each successive fused processing stage being associated with and performing processing at a successively longer scale of analysis of the signal input, and
each successive fused processing stage is coupled to a respective mode-specific processing stage of each series of mode-specific processing stages associated with a same scale of analysis for receiving an output of said mode-specific processing stage;

wherein the mode-specific processing stages include:
a first processing stage for a first input mode,
a second processing stage for the first input mode,
a first processing stage for a second input mode, and
a second processing stage for the second input mode; and

wherein the fused processing stages include:
a first fused processing stage, and
a second fused processing stage; and

wherein:
the first fused processing stage has a first input coupled to the first processing stage for the first input mode and a second input coupled to the first processing stage for the second input mode,
the second processing stage for the first input mode has an input coupled to the first processing stage for the first input mode,
the second processing stage for the second input mode has an input coupled to the first processing stage for the second input mode, and
the second fused processing stage has a first input coupled to the second processing stage for the first input mode, a second input coupled to the second processing stage for the second input mode, and a third input coupled to the first fused processing stage.