Patent ID: 11967102
Assignee: SHANGHAI UNITED IMAGING INTELLIGENCE CO., LTD.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A method for detecting key points of an object, the method comprising:
obtaining a first image of the object, wherein the first image comprises a first imaging property of the object;
obtaining a second image of the object, wherein the second image comprises a second imaging property of the object; and
processing the first image through a convolutional neural network (CNN) based on at least the first imaging property and the second imaging property to determine one or more key points of the object, wherein:
the CNN comprises a first convolution layer that includes multiple kernels each associated with a respective set of weights;
processing the first image through the CNN comprises performing, via the first convolution layer of the CNN, a first set of convolution operations on the first image based on the first imaging property of the object; and
performing the first set of convolution operations on the first image comprises, for a pixel that belongs to a patch of the first image:
identifying a corresponding patch in the second image;
adjusting a weight of the first convolution layer to be applied to the pixel, wherein the adjustment is made based on the second imaging property associated with two or more pixels of the corresponding patch in the second image; and
performing the first set of convolution operations based on the adjusted weight of the first convolution layer.