Patent ID: 11941824
Assignee: VELOCITYEHS HOLDINGS, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 10:
11. A system for determining a hand force and a ground reaction force for a musculoskeletal body of a subject, the system comprising:
a memory configured to store pose estimation instructions, force reconstruction instructions, and force optimization instructions; and
a processor configured to obtain video data for the musculoskeletal body during an action taken by the subject, the video data comprising a plurality of frames, wherein the processor is further configured to:
upon execution of the pose estimation instructions, generate, for each frame of the plurality of frames, three-dimensional pose data for the subject based on a three-dimensional skeletal model,
upon execution of the force reconstruction instructions, implement a reconstruction of the hand force and the ground reaction force exerted on the musculoskeletal body during the action based on the three-dimensional pose data, the reconstruction being configured to determine an estimate for the ground reaction force in conjunction with an estimate for the hand force such that the estimate for the hand force is based on the estimate for the ground reaction force, and
upon execution of the force optimization instructions, apply the three-dimensional pose data, the estimate for the ground reaction force, and the estimate of the hand force, to a recurrent neural network to optimize the estimate of the hand force and the estimate of the ground reaction force.