Patent ID: 11948252
Assignee: HINGE HEALTH, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. An apparatus comprising:
a communications interface at which to receive a two-dimensional image from an external source accessible via a network,
wherein the two-dimensional image includes a representation of a person;

a memory storage unit in which to store the two-dimensional image;
a pre-processing engine that is configured to generate, based on the two-dimensional image,
(i) coarse segmentation map that is representative of an outline of the person, and
(ii) a plurality of joint heatmaps, each of which provides a representation of a corresponding one of a plurality of joints of the person;

a neural network engine that is configured to:
receive the two-dimensional image, the coarse segmentation map, and the plurality of joint heatmaps as inputs, and
generate a plurality of two-dimensional maps by applying a convolutional neural network to the inputs,
wherein the plurality of two-dimensional maps includes
(i) a first front map of a front normal surface of the person,
(ii) a second front map based on the front normal surface of the person,
(iii) a first back map of a back normal surface of the person, and
(iv) a second back map based on the back normal surface of the person; and

a mesh creator engine that is configured to generate a three-dimensional mesh based on the plurality of two-dimensional maps;
wherein the neural network engine is to be further trained using at least one of the first front map, the second front map, the first back map, or the second back map.