Patent ID: 11189049

Abstract:
A computer, including a processor and a memory, the memory including instructions to be executed by the processor to determine a plurality of topological nodes wherein each topological node includes a location in real-world coordinates and a three-dimensional point cloud image of the environment at the location of the topological node and process an image acquired by a sensor included in a vehicle using a variational auto-encoder neural network trained to output a semantic point cloud image, wherein the semantic point cloud image includes regions labeled by region type and region distance relative to the vehicle. The instructions include further instructions to determine a topological node closest to the vehicle and a six degree-of-freedom pose for the vehicle relative to the topological node closest to the vehicle based on the semantic point cloud data, determine a real-world six degree-of-freedom pose for the vehicle by combining the six degree-of-freedom for the vehicle relative to the topological node and the location in real-world coordinates of the topological node closest to the vehicle and determine a location and size of a three-dimensional object in the semantic point cloud image based on three-dimensional background subtraction using the three-dimensional point cloud image included in the topological node closest to the vehicle. The instructions include further instructions to improve the three-dimensional point cloud image included in the topological node based on the semantic point cloud image and the real-world six degree-of-freedom pose for the vehicle.