Patent ID: 11875457
Assignee: ZEBRA TECHNOLOGIES CORPORATION
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A method for three-dimensional product reconstruction using multiple images collected at POS workstations, comprising:
capturing, by a barcode reader associated with a point of sale (POS) workstation, first image data associated with a plurality of products passing through a product scanning region of the POS workstation;
analyzing barcode data from the first image data captured by the barcode reader to identify at least some of the plurality of products passing through the product scanning region of the POS workstation;
responsive to identifying a product, from the plurality of products, resulting in an identified product, capturing, by one or more color cameras associated with the POS workstation, second image data associated with the identified product; and
generating, by a processor, a textured three-dimensional mesh reconstruction for the identified product based on the second image data associated with the identified product,
wherein generating the textured three-dimensional mesh reconstruction associated with the identified product based on the second image data associated with the identified product includes:
for each image of the second image data associated with the identified product;
segmenting, by the processor, the identified product from the background, or any hands in the image;
analyzing, by the processor, the segmented image of the identified product to determine a depth and a texture associated with each pixel of the identified product in the image; and
generating, by the processor, a three-dimensional point cloud associated with the segmented image of the identified product based on the depth and the texture associated with each pixel of the identified product; and

stitching, by the processor, the three-dimensional point clouds associated with each image of the second image data associated with the identified product together to generate a textured three-dimensional mesh reconstruction associated with the identified product, and
wherein stitching, by the processor, the three-dimensional point cloud associated with each image of the second image data associated with the identified product together to generate a textured three-dimensional mesh reconstruction associated with the product includes:
for each three-dimensional point cloud associated with the identified product:
identifying, by the processor, a location of a barcode or other product label in the three-dimensional point cloud; and
determining, by the processor, an orientation of the product in the three-dimensional point cloud based on the identified location of the barcode or other product label in the three-dimensional point cloud; and

stitching, by the processor, the three-dimensional point clouds associated with each image of the second image data associated with the identified product together to generate the textured three-dimensional mesh reconstruction associated with the product, based on the determined orientation of the product in each three-dimensional point cloud.