Patent ID: 11921824
Assignee: AMAZON TECHNOLOGIES, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G  B | IPC B  G

Claim 0:
1. A method comprising:
receiving first sensor data from a first sensor;
receiving second sensor data from a second sensor;
generating a first feature representation of the first sensor data using a first machine learning model;
generating a first position embedding for a first portion of the first feature representation, wherein the first position embedding relates the first portion of the first feature representation to a first spatial position of the first sensor data;
generating a second feature representation of the second sensor data using a second machine learning model;
generating a modified first feature representation of the first sensor data based at least in part on a self-attention mechanism of a transformer encoder, wherein the modified first feature representation represents a combination of the first feature representation with context from the second feature representation; and
performing a task using the modified first feature representation.