Patent ID: 11912301
Assignee: ZOOX, INC.
Field: Transport (Mechanical engineering)
Classification: CPC B  G | IPC B  G

Claim 0:
1. A system comprising:
one or more processors; and
one or more non-transitory computer-readable media storing instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising:
receiving log data associated with a vehicle operating in a first driving environment, the log data including vehicle state data associated with the vehicle, and sensor data representing the first driving environment;
determining, based at least in part on the log data, a first multi-channel top-down scenario representation of the first driving environment;
providing the first multi-channel top-down scenario representation as input to a prediction system configured to output a predicted top-down scenario representation associated with the first driving environment, wherein the prediction system comprises a neural network trained to output a predicted future scenario representation, the neural network comprising an input encoding layer and an output decoding layer;
determining a first scenario vector associated with the predicted future scenario representation, based on an output of an intermediate layer of the neural network of the prediction system;
determining that a second scenario vector is within a threshold distance to the first scenario vector, wherein the first scenario vector and the second scenario vector are represented in a multi-dimensional space;
determining, based at least in part on the second scenario vector, a second scenario representation of a second driving environment, wherein the second driving environment is different from the first driving environment; and
executing a driving simulation, based at least in part on the second scenario representation, to determine a response of an autonomous vehicle controller.