Patent ID: 11943519
Assignee: SONY INTERACTIVE ENTERTAINMENT LLC
Field: Audio-visual technology (Electrical engineering)
Classification: CPC G  H | IPC G  H

Claim 5:
6. A non-transitory computer-readable storage medium storing computer-readable instructions thereon which, when executed for a computer coupled to a device that is operated by a user with a hand of the user and on a surface of which a plurality of sensors that each output information associated with a spatial positional relation with a surface of the hand of the user are arranged, performs a method, the method comprising:
receiving the output from each of the sensors included in the device;
generating an image in which an image element having been drawn with a pixel value determined on a basis of a value represented by the output from each of the sensors is arranged at a position corresponding to a position at which the each of the sensors is arranged, on a mapping space obtained by plane-unfolding at least a portion that constitutes the surface of the device and on which the sensors are arranged; and
estimating, upon receipt of input of the generated image, information associated with a position of each of joints of the hand of the user who operates the device and outputting the estimated information as coordinate information in a three-dimensional space whose origin is placed on a point that moves with the device,
wherein the processing circuitry for estimating the information associated with a position of each of the joints is further configured to use a result of machine learning that, in a same space as a space of the input image, estimates a position closest to each of the joints of the hand of the user who operates the device and a distance from the position to each of the joints.