Patent ID: 11887257
Assignee: KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A method for virtual training, comprising:
acquiring, by a training apparatus, data for virtual training, and acquiring a three-dimensional position of a real object based on a depth image and color image of the real object and infrared (IR) data included in the obtained data;
matching, by the training apparatus, the three-dimensional position of the real object with a position of a virtual object to be applied to a virtual environment;
performing, by the training apparatus, a virtualization of an overall appearance of a user by extracting a depth from depth information on a user image included in the obtained data and matching the extracted depth with the color information;
visualizing, by the training apparatus, depth data and color data for the user obtained according to virtualization of the user in virtual training content;
performing, by the training apparatus, correction on joint information using the joint information and the depth information included in the obtained data, and estimating a posture of the user using the corrected joint information; and
estimating, by the training apparatus, a posture of a training tool using the depth information and IR data included in the obtained data;
wherein the performing of correction on joint information comprises obtaining final joint positions by applying sample points selected from the depth data for the user obtained according to the virtualization of the user and joint positions obtained from the joint information to a distance probability model, and estimating the posture of the user using the obtained final joint positions, and
wherein the applying the sample points to the distance probability model includes calculating a probability value based at least in part on a distance between a previous joint position and a sample point.