Patent ID: 11941772
Assignee: SONY INTERACTIVE ENTERTAINMENT LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 9:
10. A non-transitory, computer readable medium having a computer program comprising computer-implemented instructions stored thereon which, when run on a computer, cause the computer to implement a method of generating a three-dimensional (3D) reconstruction of a human, the method comprising:
obtaining at least one colour image and corresponding depth image of a scene, the at least one colour image and corresponding depth image comprising a human subject that is at least partially occluded by one or more items;
identifying in the at least one colour image, regions corresponding to the non-occluded parts of the human subject;
identifying in the at least one colour image, regions corresponding to one or more items occluding the human subject;
generating a point cloud of the scene based on the at least one colour image and corresponding depth image of the scene, the point cloud comprising regions corresponding to the regions identified in the at least one colour image as corresponding to the non-occluded parts of the human subject;
removing, from the point cloud, points corresponding to the one or more items identified as occluding the human subject to thereby obtain a modified point cloud for which the points corresponding to the one or more items identified as occluding the human subject have been removed;
adjusting one or more parameters of a parametric model based on the modified point cloud, the adjusted parametric model providing an estimate of points in the point cloud corresponding to the at least partially occluded parts of the human subject, wherein the parametric model defines a 3D parametrised shape of a human and wherein adjusting the one or more parameters is such that the model is morphed so as to more closely correspond to the human subject; and
generating a 3D reconstruction of the human subject based on the adjusted parametric model.