Patent ID: 11941772
Assignee: SONY INTERACTIVE ENTERTAINMENT LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 10:
11. A system for generating a three-dimensional reconstruction of a human the system comprising:
an input unit configured to obtain at least one colour image and corresponding depth image of a scene, the at least one colour image and corresponding depth image comprising a human subject that is at least partially occluded by one or more items;
an image processor configured to identify respective regions in the at least one colour image corresponding to non-occluded parts of the human subject;
a discount unit configured to identify in the at least one colour image, regions corresponding to one or more items occluding the human subject;
a point cloud generator configured to receive the at least one colour image and corresponding depth image and to generate, based thereon, a point cloud of the scene, the point cloud comprising regions corresponding to the regions in the at least one colour image identified as corresponding to the non-occluded parts of the human subject;
wherein the discount unit is configured to remove, from the point cloud, points corresponding to the one or more items identified as occluding the human subject to thereby obtain a modified point cloud for which the points corresponding to the one or more items identified as occluding the human subject have been removed;
a morphing unit configured to adjust one or more parameters of a parametric model based on the modified point such that the parametric model is morphed so as to more closely correspond to the human subject, the parametric model defining a 3D parametrised shape of a human subject, wherein the adjusted parametric model provides an estimate of points in the point cloud corresponding to the at least partially occluded parts of the human subject; and
an image generator operable to generate a 3D reconstruction of the human subject, based on the adjusted parametric model.