Patent ID: 11875457
Assignee: ZEBRA TECHNOLOGIES CORPORATION
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 5:
6. A system for three-dimensional product reconstruction using multiple images collected at POS workstations, comprising:
a barcode reader associated with a point of sale (POS) workstation configured to capture first image data associated with a plurality of products passing through a product scanning region of the POS workstation and analyze barcode data from the first image data to identify at least some of the plurality of products passing through the product scanning region of the POS workstation;
one or more color cameras associated with the POS workstation configured to, responsive to the barcode reader identifying a product, from the plurality of products, resulting in an identified product, capture second image data associated with the identified product;
a processor; and
a memory storing non-transitory, computer-readable instructions, that, when executed by the processor, cause the processor to generate a textured three-dimensional mesh reconstruction for the identified product based on the second image data associated with the identified product,
wherein the instructions, that cause the processor to generate the textured three-dimensional mesh reconstruction associated with the identified product based on the second image data associated with the identified product, include instructions that cause the processor to:
for each image of the second image data associated with the identified product;
segment the identified product from the background, or any hands in the image;
analyze the segmented image of the identified product to determine a depth and a texture associated with each pixel of the identified product in the image; and
generate a three-dimensional point cloud associated with the segmented image of the identified product based on the depth and the texture associated with each pixel of the identified product; and

stitch the three-dimensional point clouds associated with each image of the second image data associated with the identified product together to generate a textured three-dimensional mesh reconstruction associated with the identified product, and
wherein the instructions, that cause the processor to stitch the three-dimensional point cloud associated with each image of the second image data associated with the identified product together to generate a textured three-dimensional mesh reconstruction associated with the product, include instructions that cause the processor to:
for each three-dimensional point cloud associated with the identified product:
identify a location of a barcode or other product label in the three-dimensional point cloud; and
determine an orientation of the product in the three-dimensional point cloud based on the identified location of the barcode or other product label in the three-dimensional point cloud; and

stitch the three-dimensional point clouds associated with each image of the second image data associated with the identified product together to generate the textured three-dimensional mesh reconstruction associated with the product, based on the determined orientation of the product in each three-dimensional point cloud.