Patent ID: 11921824
Assignee: AMAZON TECHNOLOGIES, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G  B | IPC B  G

Claim 8:
9. A system comprising:
at least one processor;
a first sensor;
a second sensor; and
non-transitory computer-readable memory storing instructions that, when executed by the at least one processor, are effective to:
receive first sensor data from the first sensor;
receive second sensor data from the second sensor;
generate a first feature representation of the first sensor data using a first machine learning model;
generate a first position embedding for a first portion of the first feature representation, wherein the first position embedding relates the first portion of the first feature representation to a first spatial position of the first sensor data;
generate a second feature representation of the second sensor data using a second machine learning model;
generate a modified first feature representation of the first sensor data using a self-attention mechanism of a transformer encoder, wherein the modified first feature representation represents a combination of the first feature representation with context from the second feature representation; and
perform a task using the modified first feature representation.