Patent ID: 11880771
Assignee: UATC, LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 10:
11. An autonomous vehicle, comprising:
one or more sensors that generate sensor data relative to the autonomous vehicle;
one or more processors; and
one or more non-transitory computer-readable media that store instructions for execution by the one or more processors to cause the autonomous vehicle to perform operations, the operations comprising:
providing first sensor data and second sensor data of an environment of the autonomous vehicle to a neural network, wherein the first sensor data is obtained from a first sensor having a first modality, wherein the second sensor data is obtained from a second sensor having a second modality that is different than the first modality, and wherein the neural network comprises one or more continuous fusion layers configured to generate a dense representation of sensor data under a common modality;
processing the first sensor data and the second sensor data with the one or more continuous fusion layers to fuse information from a source domain associated with the first sensor into a target domain associated with the second sensor;
determining a motion plan for controlling a motion of the autonomous vehicle, wherein the motion plan is based at least in part on the fused information; and
controlling the motion of the autonomous vehicle based at least in part on the motion plan.