Patent ID: 11967102
Assignee: SHANGHAI UNITED IMAGING INTELLIGENCE CO., LTD.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 8:
9. An apparatus configured to detect key points of an object, the apparatus comprising:
one or more processors configured to:
obtain a first image of the object, wherein the first image comprises a first imaging property of the object;
obtain a second image of the object, wherein the second image comprises a second imaging property of the object; and
process the first image through a convolutional neural network (CNN) based on at least the first imaging property and the second imaging property to determine one or more key points of the object, wherein:
the CNN comprises a first convolution layer that includes multiple kernels each associated with a respective set of weights;
the one or more processors being configured to process the first image through the CNN comprises the one or more processors being configured to perform, via the first convolution layer of the CNN, a first set of convolution operations on the first image based on the first imaging property; and
the one or more processors being configured to perform the first set of convolution operations on the first image comprises the one or more processors being configured to, for a pixel that belongs to a patch of the first image:
identify a corresponding patch in the second image;
adjust a weight of the first convolution layer to be applied to the pixel, wherein the adjustment is made based on the second imaging property associated with two or more pixels of the corresponding patch in the second image; and
perform the first set of convolution operations based on the adjusted weight of the first convolution layer.