Patent AU-2022204095-A1 (AU)
Title: Tracking, analysing and assessment of human body movements using a subject-specific digital twin model of the human body
Inventor: EL-SALLAM AMAR
IPC: G06K9/00
Filed: 2022-06-12
Abstract: : 
The invention relates to systems and methods for the capture, tracking, analysis and assessment of human 
movements, action or behavior using novel digital twin model of the human and the human body. The 
digital human model, is integrated and reinforced with stat of art techniques in the area of computer 
vision, machine learning, speech processing, sport science, exercise and health to achieve the optimal 
analysis and assessment of the human body movements, behaviors, and health.  
Unlike existing approaches developed in the human movement or behavior spaces where the analysis and 
assessment are simply derived from two or three dimensional landmarks orjoints (such as those extracted 
from images or videos or sensors attached to the body), in this invention the analysis is done using an 
entire (complete) and accurate model of human-specific model combining the human shape, human 
anatomical structure and the internal contents or particles and is constrained by the clinical, physical, and 
biomechanical characteristics of the human body and the forces affecting each particle in the digital twin 
model.  
Our techniques in this invention is aimed to substantially supersede and replace the conventional and 
approximated approaches researchers and scientists have been using for decades (which in the areas such 
as sport was derived from few cadavers). The system will provide new knowledge in the motion analysis, 
tracking and movement assessment space including sport.  
The invention as a whole aims to (i) create a digital subject-specific twin model of the human and the 
human body (ii) identify, detect and extract unique markerless features representing the human body and 
its movement pattern in e.g. a video; (ii) integrate and constraint the physical and biomechanical 
characteristics of the human and the human body represented by rigid and non-rigid shape and 
composition particles into the movement paradigm and other human relevant motion analysis. A system 
with these modules and one that has these functionality is essential and critical in areas such as sport 
where a millimeter difference in a movement e.g. a jump or a hundredth of a second in a run can separate 
first from last in competitions. In sensitive areas such as health, inaccurate clinical assessment of data 
derived from human movements can lead to serious risks. This invention will substantially improve human 
movement analysis, human behavior analysis, generally human body modelling and will achieve the 
accurate assessments needed in diverse areas including sport, exercise, science and health applications.
100 160110 
120 
Constraint standarized clinical, physical, ecological 
an biomechanical data of the human body Memory 
140 170 18012 
Participant Participant- specific 
another data physical activity module Digitalhuman Co 
150 130 
Other human relevant data C means 
in4 dn movement 
patterns 
Figure 1: A block diagram describing an overall summary of the invented system, 
I