Patent ID: 11966838
Assignee: NVIDIA CORPORATION
Field: Measurement (Instruments)
Classification: CPC G | IPC G

Claim 12:
13. A processor comprising:
processing circuitry to:
compute, using one or more neural networks and based at least on sensor data generated using one or more sensors of a machine, trajectory data representative of one or more world space trajectory points corresponding to one or more future time steps; and
control the machine, at least in part, according to the one or more world space trajectory points,
wherein the one or more neural networks are trained using:
ground truth data representative of world space trajectory information, the world space trajectory information corresponding to one or more trajectories used to navigate a test machine within a real-world environment;
image data generated using the test machine and at least partly while the test machine navigated the one or more trajectories within the real-world environment, the image data representative of one or more images depicting at least a portion of the real-world environment; and
one or more annotations associated with the ground truth data, an individual annotation of the one or more annotations associating a point along a trajectory of the one or more trajectories with an image of the one or more images; and
a comparison of the one or more trajectories to one or more predicted trajectories of the one or more machine learning models, the one or more predicted trajectories determined based at least on the one or more machine learning models processing the image data and associated with the one or more trajectories using the one or more annotations.