Patent ID: 11921824
Assignee: AMAZON TECHNOLOGIES, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G  B | IPC B  G

Claim 15:
16. A method comprising:
receiving a first sensor data from a first image sensor, the first sensor data comprising a first frame of image data;
receiving second sensor data from a light detection and ranging (LIDAR) sensor, the second sensor data comprising three-dimensional data;
generating a first feature representation of the first frame of image data using a first machine learning model;
generating a first position embedding for a first portion of the first feature representation, wherein the first position embedding relates the first portion of the first feature representation to a first spatial position of the first sensor data;
generating a second feature representation of the three-dimensional data using a second machine learning model;
generating a modified first feature representation of the first sensor data based at least in part on a self-attention mechanism of a transformer encoder, wherein the modified first feature representation represents a combination of the first feature representation with context from the second feature representation; and
performing a task using the modified first feature representation.