# Aided Evaluation of Motion Action Based on Attitude Recognition

Authors: Qi Wang; Qing-Ming Wang
Journal: Journal of Healthcare Engineering
 (2022)

---

## Abstract

For athletes who are eager for success, it is difficult to obtain their own movement data due to field equipment, artificial errors, and other factors, which means that they cannot get professional movement guidance and posture correction from sports coaches, which is a disastrous problem. To solve this big problem, combined with the latest research results of deep learning in the field of computer technology, based on the related technology of human posture recognition, this paper uses convolution neural network and video processing technology to create an auxiliary evaluation system of sports movements, which can obtain accurate data and help people interact with each other, so as to help athletes better understand their body posture and movement data. The research results show that: (1) using OpenPose open-source library for pose recognition, joint angle data can be obtained through joint coordinates, and the key points of video human posture can be identified and calculated for easy analysis. (2) The movements of the human body in the video are evaluated. In this way, it is judged whether the action amplitude of the detected target conforms to the standard action data. (3) According to the standard motion database created in this paper, a formal motion auxiliary evaluation system is established; compared with the standard action, the smaller the Euclidean distance is, the more standard it is. The action with an Euclidean distance of 4.79583 is the best action of the tested person. (4) The efficiency of traditional methods is very low, and the correct recognition rate of the method based on BP neural network can be as high as 96.4%; the correct recognition rate of the attitude recognition method based on this paper can be as high as 98.7%, which is 2.3% higher than the previous method. Therefore, the method in this paper has great advantages. The research results of the sports action assistant evaluation system in this paper are good, which effectively solves the difficult problems that plague athletes and can be considered to have achieved certain success; the follow-up system test and operation work need further optimization and research by researchers.


---

## Body

## 1. Introduction

Traditional sports training is faced with some difficult problems, such as venue, equipment, professionals, and difficulty in recording, which are limiting the development of athletes’ sports quality. Therefore, designing an auxiliary evaluation system that not only can observe and identify athletes’ body posture but also can carry out professional movements according to these athletes’ body posture data can help athletes train freely anytime, anywhere, and every moment to the maximum extent and record real and effective real-time records. In this way, the cooperation between sports and computer cutting-edge technology contributes to the intelligence of sports. The article refers to a large number of computer technology journals and sports-related research results, which provides a solid theoretical basis and scientific data support for this article. Video image processing technology is maturing day by day, considering that computer vision involves many fields so far. Various applications (artificial intelligence, pattern recognition, etc.) have a good development trend and are closely related to convolution neural networks in deep learning, so this paper combines several technologies with sports. Reference [1] proposes a rule-based motion recognition algorithm for bone information obtained by depth sensors. Literature [2] designed an aerobics auxiliary evaluation system based on big data and motion recognition algorithm. Literature [3] talks about personal data privacy protection in the era of big data. In reference [4], a new motion recognition method based on key frame and skeleton information is proposed by using Kinect v2 and the weighted K-means algorithm. Reference [5] proposes an improved adaptive human body region segmentation method for human body contour extraction. Reference [6] uses AIC large image data set to understand images more deeply. Reference [7] proposes the FV coding method and automatic scoring technology of human motion features in monocular motion video with local spatio-temporal preservation. Reference [8] proposes a 3D convolution neural network fusing temporal and spatial motion information for human behavior recognition in video. Reference [9] combines optimization algorithm of human posture estimation with deformation model. Reference [10] proposes an acceleration algorithm based on GPU parallel architecture. In reference [11], a point tracking system based on a deep convolution neural network is used to extract feature points and estimate cameras. Document [12] selects machine learning support vector machine algorithm and deep learning framework model for implementation. Reference [13] extracts the descriptor operator of badminton players’ motion recognition from video by using the grid classification method of local analysis. Reference [14] proposes a deformable deep scroll neural network for general object detection. Reference [15] proposes a human motion attitude recognition model based on Hu moment invariants and an optimized support vector machine.


## 2. Theoretical Basis

### 2.1. Convolution Neural Network

#### 2.1.1. Overview of Convolution Neural Network

Convolution neural network [16]: t description of neurons is shown in Table 1.Table 1
Description of neurons.
A natural neuronCompositionNeuronal nucleusDendrites [17]AxonExplanation: Axons are branched off to connect with dendrites of other neurons to form synapses. Artificial neurons have a similar structure, which also contains a nucleus (processing unit), multiple dendrites (similar to the input), and an axon (similar to the output).“CNN” belongs to a special kind of artificial neuron, as shown in Figure1.Figure 1
Artificial neuron.“CNN” is a favorite of researchers in deep learning methods, and its research results are quite rich and successful in recent years. It is usually used for processes corresponding to natural access and language. Generally, three-dimensional CNN has two operations: convolution and pooling as shown in Figure2.Figure 2
Single-layer convolution neural network.The important formulas of the convolution layer are as follows:(1)Zl+1i,j=Zl⊗ωl+1i,j+b,(2)Zl+1i,j=∑k=1Kl∑x=1f∑y=1fZkls0i+x,s0j+yωkl+1x,y+b,(3)Ll+1=Ll+2p−fs0+1i,j∈0,1,...Ll+1,(4)Zl+1=∑k=1Kl∑i=1L∑j=1LZi,j,klωkl+1+b=ωl+1TZl+1+b,(5)Ll+1=L.The excitation function that assists in expressing complex characteristics, the expression form of Lp pooling, and the linear combination of hybrid pooling are shown in the following formulas:(6)Ai,j,kl=fZi,j,kl,(7)Akli,j=∑x=1f∑y=1fAkls0i+x,s0j+yp1/p,(8)Akl=λL1Akl+L∞Akl,λ∈0,1.


#### 2.1.2. Feature Extraction

In traditional machine learning, the parameters of the classifier can be obtained from the training data, while the feature extractor can be selected. In a convolution neural network, convolution is a feature extractor, and a neural network is equivalent to the classifier. When we train a convolution neural network, it is equivalent to training feature extractor and classifier. We collate some feature extractors designed with convolution neural network, so as to select the most suitable feature extractor for this paper, as shown in Table2.Table 2
Feature extractor based on convolution neural network design.
NameDescriptionLeNet [18]Proposed by LeCun in 1998, it is the first CNN. It has a seven-level convolution network dedicated to classifying numbers and has the ability to classify numbers without being affected by minor distortion, rotation, and changes in position and scale.AlexNetProposed by Krizhevesky et al., by deepening CNN and applying many parameter optimization strategies to enhance CNN’s learning ability, it is considered as the first deep CNN architecture, showing the pioneering achievements of image classification and recognition tasks.ZefNetIt is recognized as the winner of ILSVRC (CNN competition) in 2013. It uses deconvolution to visually analyze CNN’s intermediate feature map, finds a way to improve the model by analyzing feature behavior, and fine-tunes AlexNet to improve its performance. It manages to achieve a Top-5 error rate of only 14.8%. This achievement of ZefNet is achieved by adjusting AlexNet’s super parameters and keeping the same structure. In order to further improve the effectiveness and accuracy of ZefNet, more deep learning elements have been added.GoogleNetGoogleNet, which won the 2014-ILSVRC competition, introduced a new concept of inception blocks into CNN, integrating multiscale convolution transformations through split, transform, and merge ideas. This block encapsulates filters of different sizes (1 × 1, 3 × 3, and 5 × 5) to capture spatial information of different scales (fine-grained and coarse-grained). In addition to improving learning ability, GoogleNet focuses on improving the efficiency of CNN parameters.VGG [19]With the successful application of CNN in image recognition, Simonyan et al. put forward a simple and effective design principle of CNN architecture. Their architecture, called VGG, is a modular layered pattern. VGG has a depth of 19 layers to simulate the relationship between depth and network presentation ability. VGG replaces 11 × 11 and 5 × 5 filters with a stack of 3 × 3 convolution layers. Experiments show that placing 3 × 3 filters at the same time can achieve the effect of large-size filters.The traditional classification model is shown in the following formula:(9)y=fx,θclassifier,wheref represents the feature extraction function, x represents the original data, and θclassifier represents the classifier.The expression form of the volume integral class model function is shown in the following formula:(10)y=fx,θfilter,θclassifier,where θfilter represents the parameter in the feature extractor.


### 2.2. Human Posture Recognition Technology

Attitude recognition technology finds out the key parts of the human body in images. It is embodied in games, animation modeling, action recognition, and other fields. This technology needs to be optimized all the time to ensure that the recognition of human posture can be very accurate regardless of whether there are clothes shading, the influence of light and shade changes, joints are difficult to observe, and other problems. The site affinity field was selected to treat the key points. In recent years, there are many data sets related to the detection of key parts. Here, as shown in Table3, we list six commonly used human posture databases.Table 3
Examples of 2D human posture data set.
Data setTypeNumber of joint pointsNumber of samples/103UsageLSPSingle person142Basic abandonmentFLICSingle person920Basic abandonmentMPII [20]Single person, multiple person1625MainstreamMSC0C0Multiple persons17>300MainstreamAI challengerMultiple persons14380Competition onlyPoseTrack [21]Multiple persons15>20 frameMost of them are used for attitude tracking


### 2.3. Action Evaluation Correlation

It is necessary to create and design an action evaluation method suitable for this paper to process the detected human posture data as shown in Table4.Table 4
Motion evaluation method.
MethodDescriptionTemplate-based methodIn the matching mode, the action sequence to be detected is compared with the pre-established style action library according to a specific time order, and the action similarity is introduced to evaluate the action. When encountering complex action, we don’t need to pay attention to the time order when studying its action. We can use the dynamic matching method to compare and analyze the actions at any time in the action sequence to be detected with the style action library. Next, find the best way to match these two methods to achieve the effect of motion recognition and classification.Method based on state space [22]The hidden Markov (HMN) model is one of the most convincing methods in this type of action evaluation. Researchers put forward Bayesian network based on probability inference, which eliminates uncertainty and incompleteness. Compared with the link structure of HMN, Bayesian network is a directed graph describing a random process, which well expresses the time and sequence transformation of the state.(11)PA|B=PB|A∗PA/PB.


### 2.4. Computer Video Processing Technology

#### 2.4.1. Image Correlation Processing

Digital images are represented by two-dimensional arrays.(1)
Grayening of image [23](12)Gray=R∗0.3+G∗0.59+B∗0.11,(13)Gray=R∗30+G∗0.59+B∗11/100,(14)Gray=R∗76+G∗151+B∗28≫8,(15)Gray=R+G+B/3,(16)Gray=G.(2)
Image binarization(17)gx,y=0GrayvalueislessthanthresholdT,255GrayvalueisgreaterthanthresholdT..(3)
Enhancement and sharpening(18)dx,y=fx,y−gx,y,(19)sk=∑i=0kprri=∑i=0knin.(4)
Edge detection [24](20)∇2fx,y=∂2fx,y∂x2+∂2fx,y∂y2,(21)∇2fx,y=fx+1,y+fx−1,y+fx,y+1+fx,y−1−4fx+1,y.Figure 3
RGB color space representation.Figure 4
HSV color space representation.


#### 2.4.2. Motion Video Correlation Processing

(1)
Video Transform [25]The video camera finally outputs the RGB format video image. Converting it to HSV format can reduce the image preprocessing time and improve the overall efficiency of image recognition after image processing, as shown in Figures3 and 4.The relevant formula is expressed as follows:(22)H=0,max=min60×G−Bmax−min+0,max=r,G≥B60×G−Bmax−min+360,max=r,G<B60×B−Rmax−min+120,max=G60×R−Gmax−min+0,max=B,(23)S=0,max=01−minmax,max≠0,(24)V=max255.(2)
Compensation of motion residualsWhen the human body moves, it is easily interfered by light and shadow or external signal environment, including color shift, loss, jitter, abnormal brightness, and so on. At this time, motion residuals will appear. When calculating the residual value of each pixel, we can set the energy law index of the video image together. The formula for calculating the residual value is as follows:(25)Δlossx,y=fx,y1−Px,yΔweightedx,y=fx,yPx,yΔpresx,y=Δlossx,y1−SAx,yρfx,y=Δweightedx,y+Δpresx,y,whereΔlossx,y, Δweightedx,y, and Δpresx,y represent the weighted residuals perceived by video images; Px,y and SAx,y, respectively, representing the residual value of each pixel and the space in the video scene; and ρ represents the exponent of the set energy law.(3)
Image filtering(26)Imid=Medi=Iin+12,nisanoddnumber12Iin2+Iin+12,nisanevennumber,(27)gx,y=Medfi,j,i,j.(4)
Similarity between feature vectors of human motion posture(28)Simi,j=BRi−BRj.


## 2.1. Convolution Neural Network

### 2.1.1. Overview of Convolution Neural Network

Convolution neural network [16]: t description of neurons is shown in Table 1.Table 1
Description of neurons.
A natural neuronCompositionNeuronal nucleusDendrites [17]AxonExplanation: Axons are branched off to connect with dendrites of other neurons to form synapses. Artificial neurons have a similar structure, which also contains a nucleus (processing unit), multiple dendrites (similar to the input), and an axon (similar to the output).“CNN” belongs to a special kind of artificial neuron, as shown in Figure1.Figure 1
Artificial neuron.“CNN” is a favorite of researchers in deep learning methods, and its research results are quite rich and successful in recent years. It is usually used for processes corresponding to natural access and language. Generally, three-dimensional CNN has two operations: convolution and pooling as shown in Figure2.Figure 2
Single-layer convolution neural network.The important formulas of the convolution layer are as follows:(1)Zl+1i,j=Zl⊗ωl+1i,j+b,(2)Zl+1i,j=∑k=1Kl∑x=1f∑y=1fZkls0i+x,s0j+yωkl+1x,y+b,(3)Ll+1=Ll+2p−fs0+1i,j∈0,1,...Ll+1,(4)Zl+1=∑k=1Kl∑i=1L∑j=1LZi,j,klωkl+1+b=ωl+1TZl+1+b,(5)Ll+1=L.The excitation function that assists in expressing complex characteristics, the expression form of Lp pooling, and the linear combination of hybrid pooling are shown in the following formulas:(6)Ai,j,kl=fZi,j,kl,(7)Akli,j=∑x=1f∑y=1fAkls0i+x,s0j+yp1/p,(8)Akl=λL1Akl+L∞Akl,λ∈0,1.


### 2.1.2. Feature Extraction

In traditional machine learning, the parameters of the classifier can be obtained from the training data, while the feature extractor can be selected. In a convolution neural network, convolution is a feature extractor, and a neural network is equivalent to the classifier. When we train a convolution neural network, it is equivalent to training feature extractor and classifier. We collate some feature extractors designed with convolution neural network, so as to select the most suitable feature extractor for this paper, as shown in Table2.Table 2
Feature extractor based on convolution neural network design.
NameDescriptionLeNet [18]Proposed by LeCun in 1998, it is the first CNN. It has a seven-level convolution network dedicated to classifying numbers and has the ability to classify numbers without being affected by minor distortion, rotation, and changes in position and scale.AlexNetProposed by Krizhevesky et al., by deepening CNN and applying many parameter optimization strategies to enhance CNN’s learning ability, it is considered as the first deep CNN architecture, showing the pioneering achievements of image classification and recognition tasks.ZefNetIt is recognized as the winner of ILSVRC (CNN competition) in 2013. It uses deconvolution to visually analyze CNN’s intermediate feature map, finds a way to improve the model by analyzing feature behavior, and fine-tunes AlexNet to improve its performance. It manages to achieve a Top-5 error rate of only 14.8%. This achievement of ZefNet is achieved by adjusting AlexNet’s super parameters and keeping the same structure. In order to further improve the effectiveness and accuracy of ZefNet, more deep learning elements have been added.GoogleNetGoogleNet, which won the 2014-ILSVRC competition, introduced a new concept of inception blocks into CNN, integrating multiscale convolution transformations through split, transform, and merge ideas. This block encapsulates filters of different sizes (1 × 1, 3 × 3, and 5 × 5) to capture spatial information of different scales (fine-grained and coarse-grained). In addition to improving learning ability, GoogleNet focuses on improving the efficiency of CNN parameters.VGG [19]With the successful application of CNN in image recognition, Simonyan et al. put forward a simple and effective design principle of CNN architecture. Their architecture, called VGG, is a modular layered pattern. VGG has a depth of 19 layers to simulate the relationship between depth and network presentation ability. VGG replaces 11 × 11 and 5 × 5 filters with a stack of 3 × 3 convolution layers. Experiments show that placing 3 × 3 filters at the same time can achieve the effect of large-size filters.The traditional classification model is shown in the following formula:(9)y=fx,θclassifier,wheref represents the feature extraction function, x represents the original data, and θclassifier represents the classifier.The expression form of the volume integral class model function is shown in the following formula:(10)y=fx,θfilter,θclassifier,where θfilter represents the parameter in the feature extractor.


## 2.1.1. Overview of Convolution Neural Network

Convolution neural network [16]: t description of neurons is shown in Table 1.Table 1
Description of neurons.
A natural neuronCompositionNeuronal nucleusDendrites [17]AxonExplanation: Axons are branched off to connect with dendrites of other neurons to form synapses. Artificial neurons have a similar structure, which also contains a nucleus (processing unit), multiple dendrites (similar to the input), and an axon (similar to the output).“CNN” belongs to a special kind of artificial neuron, as shown in Figure1.Figure 1
Artificial neuron.“CNN” is a favorite of researchers in deep learning methods, and its research results are quite rich and successful in recent years. It is usually used for processes corresponding to natural access and language. Generally, three-dimensional CNN has two operations: convolution and pooling as shown in Figure2.Figure 2
Single-layer convolution neural network.The important formulas of the convolution layer are as follows:(1)Zl+1i,j=Zl⊗ωl+1i,j+b,(2)Zl+1i,j=∑k=1Kl∑x=1f∑y=1fZkls0i+x,s0j+yωkl+1x,y+b,(3)Ll+1=Ll+2p−fs0+1i,j∈0,1,...Ll+1,(4)Zl+1=∑k=1Kl∑i=1L∑j=1LZi,j,klωkl+1+b=ωl+1TZl+1+b,(5)Ll+1=L.The excitation function that assists in expressing complex characteristics, the expression form of Lp pooling, and the linear combination of hybrid pooling are shown in the following formulas:(6)Ai,j,kl=fZi,j,kl,(7)Akli,j=∑x=1f∑y=1fAkls0i+x,s0j+yp1/p,(8)Akl=λL1Akl+L∞Akl,λ∈0,1.


## 2.1.2. Feature Extraction

In traditional machine learning, the parameters of the classifier can be obtained from the training data, while the feature extractor can be selected. In a convolution neural network, convolution is a feature extractor, and a neural network is equivalent to the classifier. When we train a convolution neural network, it is equivalent to training feature extractor and classifier. We collate some feature extractors designed with convolution neural network, so as to select the most suitable feature extractor for this paper, as shown in Table2.Table 2
Feature extractor based on convolution neural network design.
NameDescriptionLeNet [18]Proposed by LeCun in 1998, it is the first CNN. It has a seven-level convolution network dedicated to classifying numbers and has the ability to classify numbers without being affected by minor distortion, rotation, and changes in position and scale.AlexNetProposed by Krizhevesky et al., by deepening CNN and applying many parameter optimization strategies to enhance CNN’s learning ability, it is considered as the first deep CNN architecture, showing the pioneering achievements of image classification and recognition tasks.ZefNetIt is recognized as the winner of ILSVRC (CNN competition) in 2013. It uses deconvolution to visually analyze CNN’s intermediate feature map, finds a way to improve the model by analyzing feature behavior, and fine-tunes AlexNet to improve its performance. It manages to achieve a Top-5 error rate of only 14.8%. This achievement of ZefNet is achieved by adjusting AlexNet’s super parameters and keeping the same structure. In order to further improve the effectiveness and accuracy of ZefNet, more deep learning elements have been added.GoogleNetGoogleNet, which won the 2014-ILSVRC competition, introduced a new concept of inception blocks into CNN, integrating multiscale convolution transformations through split, transform, and merge ideas. This block encapsulates filters of different sizes (1 × 1, 3 × 3, and 5 × 5) to capture spatial information of different scales (fine-grained and coarse-grained). In addition to improving learning ability, GoogleNet focuses on improving the efficiency of CNN parameters.VGG [19]With the successful application of CNN in image recognition, Simonyan et al. put forward a simple and effective design principle of CNN architecture. Their architecture, called VGG, is a modular layered pattern. VGG has a depth of 19 layers to simulate the relationship between depth and network presentation ability. VGG replaces 11 × 11 and 5 × 5 filters with a stack of 3 × 3 convolution layers. Experiments show that placing 3 × 3 filters at the same time can achieve the effect of large-size filters.The traditional classification model is shown in the following formula:(9)y=fx,θclassifier,wheref represents the feature extraction function, x represents the original data, and θclassifier represents the classifier.The expression form of the volume integral class model function is shown in the following formula:(10)y=fx,θfilter,θclassifier,where θfilter represents the parameter in the feature extractor.


## 2.2. Human Posture Recognition Technology

Attitude recognition technology finds out the key parts of the human body in images. It is embodied in games, animation modeling, action recognition, and other fields. This technology needs to be optimized all the time to ensure that the recognition of human posture can be very accurate regardless of whether there are clothes shading, the influence of light and shade changes, joints are difficult to observe, and other problems. The site affinity field was selected to treat the key points. In recent years, there are many data sets related to the detection of key parts. Here, as shown in Table3, we list six commonly used human posture databases.Table 3
Examples of 2D human posture data set.
Data setTypeNumber of joint pointsNumber of samples/103UsageLSPSingle person142Basic abandonmentFLICSingle person920Basic abandonmentMPII [20]Single person, multiple person1625MainstreamMSC0C0Multiple persons17>300MainstreamAI challengerMultiple persons14380Competition onlyPoseTrack [21]Multiple persons15>20 frameMost of them are used for attitude tracking


## 2.3. Action Evaluation Correlation

It is necessary to create and design an action evaluation method suitable for this paper to process the detected human posture data as shown in Table4.Table 4
Motion evaluation method.
MethodDescriptionTemplate-based methodIn the matching mode, the action sequence to be detected is compared with the pre-established style action library according to a specific time order, and the action similarity is introduced to evaluate the action. When encountering complex action, we don’t need to pay attention to the time order when studying its action. We can use the dynamic matching method to compare and analyze the actions at any time in the action sequence to be detected with the style action library. Next, find the best way to match these two methods to achieve the effect of motion recognition and classification.Method based on state space [22]The hidden Markov (HMN) model is one of the most convincing methods in this type of action evaluation. Researchers put forward Bayesian network based on probability inference, which eliminates uncertainty and incompleteness. Compared with the link structure of HMN, Bayesian network is a directed graph describing a random process, which well expresses the time and sequence transformation of the state.(11)PA|B=PB|A∗PA/PB.


## 2.4. Computer Video Processing Technology

### 2.4.1. Image Correlation Processing

Digital images are represented by two-dimensional arrays.(1)
Grayening of image [23](12)Gray=R∗0.3+G∗0.59+B∗0.11,(13)Gray=R∗30+G∗0.59+B∗11/100,(14)Gray=R∗76+G∗151+B∗28≫8,(15)Gray=R+G+B/3,(16)Gray=G.(2)
Image binarization(17)gx,y=0GrayvalueislessthanthresholdT,255GrayvalueisgreaterthanthresholdT..(3)
Enhancement and sharpening(18)dx,y=fx,y−gx,y,(19)sk=∑i=0kprri=∑i=0knin.(4)
Edge detection [24](20)∇2fx,y=∂2fx,y∂x2+∂2fx,y∂y2,(21)∇2fx,y=fx+1,y+fx−1,y+fx,y+1+fx,y−1−4fx+1,y.Figure 3
RGB color space representation.Figure 4
HSV color space representation.


### 2.4.2. Motion Video Correlation Processing

(1)
Video Transform [25]The video camera finally outputs the RGB format video image. Converting it to HSV format can reduce the image preprocessing time and improve the overall efficiency of image recognition after image processing, as shown in Figures3 and 4.The relevant formula is expressed as follows:(22)H=0,max=min60×G−Bmax−min+0,max=r,G≥B60×G−Bmax−min+360,max=r,G<B60×B−Rmax−min+120,max=G60×R−Gmax−min+0,max=B,(23)S=0,max=01−minmax,max≠0,(24)V=max255.(2)
Compensation of motion residualsWhen the human body moves, it is easily interfered by light and shadow or external signal environment, including color shift, loss, jitter, abnormal brightness, and so on. At this time, motion residuals will appear. When calculating the residual value of each pixel, we can set the energy law index of the video image together. The formula for calculating the residual value is as follows:(25)Δlossx,y=fx,y1−Px,yΔweightedx,y=fx,yPx,yΔpresx,y=Δlossx,y1−SAx,yρfx,y=Δweightedx,y+Δpresx,y,whereΔlossx,y, Δweightedx,y, and Δpresx,y represent the weighted residuals perceived by video images; Px,y and SAx,y, respectively, representing the residual value of each pixel and the space in the video scene; and ρ represents the exponent of the set energy law.(3)
Image filtering(26)Imid=Medi=Iin+12,nisanoddnumber12Iin2+Iin+12,nisanevennumber,(27)gx,y=Medfi,j,i,j.(4)
Similarity between feature vectors of human motion posture(28)Simi,j=BRi−BRj.


## 2.4.1. Image Correlation Processing

Digital images are represented by two-dimensional arrays.(1)
Grayening of image [23](12)Gray=R∗0.3+G∗0.59+B∗0.11,(13)Gray=R∗30+G∗0.59+B∗11/100,(14)Gray=R∗76+G∗151+B∗28≫8,(15)Gray=R+G+B/3,(16)Gray=G.(2)
Image binarization(17)gx,y=0GrayvalueislessthanthresholdT,255GrayvalueisgreaterthanthresholdT..(3)
Enhancement and sharpening(18)dx,y=fx,y−gx,y,(19)sk=∑i=0kprri=∑i=0knin.(4)
Edge detection [24](20)∇2fx,y=∂2fx,y∂x2+∂2fx,y∂y2,(21)∇2fx,y=fx+1,y+fx−1,y+fx,y+1+fx,y−1−4fx+1,y.Figure 3
RGB color space representation.Figure 4
HSV color space representation.


## 2.4.2. Motion Video Correlation Processing

(1)
Video Transform [25]The video camera finally outputs the RGB format video image. Converting it to HSV format can reduce the image preprocessing time and improve the overall efficiency of image recognition after image processing, as shown in Figures3 and 4.The relevant formula is expressed as follows:(22)H=0,max=min60×G−Bmax−min+0,max=r,G≥B60×G−Bmax−min+360,max=r,G<B60×B−Rmax−min+120,max=G60×R−Gmax−min+0,max=B,(23)S=0,max=01−minmax,max≠0,(24)V=max255.(2)
Compensation of motion residualsWhen the human body moves, it is easily interfered by light and shadow or external signal environment, including color shift, loss, jitter, abnormal brightness, and so on. At this time, motion residuals will appear. When calculating the residual value of each pixel, we can set the energy law index of the video image together. The formula for calculating the residual value is as follows:(25)Δlossx,y=fx,y1−Px,yΔweightedx,y=fx,yPx,yΔpresx,y=Δlossx,y1−SAx,yρfx,y=Δweightedx,y+Δpresx,y,whereΔlossx,y, Δweightedx,y, and Δpresx,y represent the weighted residuals perceived by video images; Px,y and SAx,y, respectively, representing the residual value of each pixel and the space in the video scene; and ρ represents the exponent of the set energy law.(3)
Image filtering(26)Imid=Medi=Iin+12,nisanoddnumber12Iin2+Iin+12,nisanevennumber,(27)gx,y=Medfi,j,i,j.(4)
Similarity between feature vectors of human motion posture(28)Simi,j=BRi−BRj.


## 3. Motion-Aided Evaluation System Based on Attitude Recognition

### 3.1. Moving Target Detection

The most important step in the system is to process the computer video when carrying out the auxiliary evaluation of sports actions. Only when the moving target is detected smoothly can the following series of operation processes be realized, as shown in Figure5.Figure 5
Flow chart of moving target detection.Firstly, we construct the background model of the video image. Its principle is that the capture time interval of each frame of moving image is short, and several frames of images recorded by us are at the same position, so the position is the background pixel. And pixel combinations can get accurate background images. The pixel value and gray value of the background image are unified, and the background is subtracted to obtain the moving area of the target. Whether the pixel value changes in the area is observed in several consecutive video frames, so as to determine whether the target in the area is in a moving state.


### 3.2. Human Posture Recognition Module

#### 3.2.1. OpenPose Attitude Recognition

We chose the OpenPose open-source library, and the training set is provided by CMU Panoptic Studio. This algorithm can detect real-time, multitarget selection, in the recognition of the human body in many of the research obtained a lot of successful cases, so there are many cases that can be referred to. The affinity field is used to associate key body parts. It can effectively detect the 2D action posture of a single person or multiple people in the video image to be detected. Finally, the coordinate file with body key points marked on the detected target on the original image is output.(29)Lt=ϕF,Lt−1,∀2≤t≤Tp,(30)STP=ρtF,LTP,∀t=TP,(31)St=ρtF,LTP,St−1,∀TP<t≤TP+TC.The key points obtained by this module should be accurate and conform to the normal motion posture extraction, so as to evaluate correctly, as shown in Figure6.Figure 6
Workflow of human posture recognition module.


#### 3.2.2. Application of Motion Evaluation Method

As shown in Figure7, the premise of action recognition also needs to deal with things describing action rules. When we describe the action, we can use the joint points of the human body to calculate the joint angle of the human body by finding a cosine angle with known three-point coordinates. Eight joint angles were selected as human movement indexes, as shown in Table 5.Figure 7
Action description rule workflow.Table 5
Selection of joint angle.
Joint angle numberJoint point1Head, neck, left shoulder2Left shoulder, left elbow, left wrist3Right shoulder, right elbow, right wrist4Left elbow, left shoulder, left hip5Right elbow, right shoulder, right hip6Left knee, neck, right knee7Left hip, left knee, left foot8Right hip, right knee, right foot


### 3.3. Design and Implementation of the System

#### 3.3.1. System Development Platform

It is shown in Table6.Table 6
Main configuration.
Hardware platformSoftware platformCPU: Intel (R) core (TM) i5-8300H 2.30 GHz; GPU: NVIDIA GeForce GTX1050Ti 4G; disk: Samsung MZVLB256HAHQ 237G; memory: Samsung DDR4 2666 MHz 8 GBThe software platform is mainly built in visual studio 2015 environment. Open-source computer vision library OpenCV, Microsoft MFC interface library, CUDA architecture, and GPU acceleration library cuDNN are used. The system uses C++ for development, using C++ file operation classes of stream, if stream involved in the program files, data types, text flow, and other objects for processing.


#### 3.3.2. Overall Design of the System

The General Design of Motion Attitude Recognition Process. As shown in Figure 8, two databases are created during the recognition of motion posture. These two databases are very important, one of which can capture human motion; the other is a database of processed human motion characteristics. Every step is fully considered in the whole process design, whether it is the interception and capture of video images or the feature matching of data and so on. Through our process, we can give more accurate recognition results in detail.Figure 8
Flow chart of automatic motion attitude recognition.Design of the Aided Evaluation System for Motion. As shown in Figure 9, before logging in, you must register your identity to ensure security and privacy. During the whole operation process, the system will automatically save all the data every 5 min with the increase of time and store them in the information center of the user. If the user stops using it, the system will immediately save all the test-related information. After more than 20 min, the system automatically shuts down. After the system is shut down, if the user needs to use it, he must reopen the interface, open his own data repository, and reopen the interface.Figure 9
Overall function of the system.The Personal Information Module Has Special Password Management. Standard action database provides the most powerful support for the database system, and the application of data needs this module to participate. Here, it will open the picture to be processed for posture feature extraction and find the joint angle of the detected target as an evaluation reference. Of course, this part will also provide the function of adding actions and deleting actions.As its name implies, the auxiliary teaching module provides users with an opportunity to practice. After getting the joint angle, users can compare the similarity between the actions in the database and the actions in the database and, finally, output the final detection results.All the functions of the overall evaluation module are offline, and users can use the functions without hindrance without a network.


## 3.1. Moving Target Detection

The most important step in the system is to process the computer video when carrying out the auxiliary evaluation of sports actions. Only when the moving target is detected smoothly can the following series of operation processes be realized, as shown in Figure5.Figure 5
Flow chart of moving target detection.Firstly, we construct the background model of the video image. Its principle is that the capture time interval of each frame of moving image is short, and several frames of images recorded by us are at the same position, so the position is the background pixel. And pixel combinations can get accurate background images. The pixel value and gray value of the background image are unified, and the background is subtracted to obtain the moving area of the target. Whether the pixel value changes in the area is observed in several consecutive video frames, so as to determine whether the target in the area is in a moving state.


## 3.2. Human Posture Recognition Module

### 3.2.1. OpenPose Attitude Recognition

We chose the OpenPose open-source library, and the training set is provided by CMU Panoptic Studio. This algorithm can detect real-time, multitarget selection, in the recognition of the human body in many of the research obtained a lot of successful cases, so there are many cases that can be referred to. The affinity field is used to associate key body parts. It can effectively detect the 2D action posture of a single person or multiple people in the video image to be detected. Finally, the coordinate file with body key points marked on the detected target on the original image is output.(29)Lt=ϕF,Lt−1,∀2≤t≤Tp,(30)STP=ρtF,LTP,∀t=TP,(31)St=ρtF,LTP,St−1,∀TP<t≤TP+TC.The key points obtained by this module should be accurate and conform to the normal motion posture extraction, so as to evaluate correctly, as shown in Figure6.Figure 6
Workflow of human posture recognition module.


### 3.2.2. Application of Motion Evaluation Method

As shown in Figure7, the premise of action recognition also needs to deal with things describing action rules. When we describe the action, we can use the joint points of the human body to calculate the joint angle of the human body by finding a cosine angle with known three-point coordinates. Eight joint angles were selected as human movement indexes, as shown in Table 5.Figure 7
Action description rule workflow.Table 5
Selection of joint angle.
Joint angle numberJoint point1Head, neck, left shoulder2Left shoulder, left elbow, left wrist3Right shoulder, right elbow, right wrist4Left elbow, left shoulder, left hip5Right elbow, right shoulder, right hip6Left knee, neck, right knee7Left hip, left knee, left foot8Right hip, right knee, right foot


## 3.2.1. OpenPose Attitude Recognition

We chose the OpenPose open-source library, and the training set is provided by CMU Panoptic Studio. This algorithm can detect real-time, multitarget selection, in the recognition of the human body in many of the research obtained a lot of successful cases, so there are many cases that can be referred to. The affinity field is used to associate key body parts. It can effectively detect the 2D action posture of a single person or multiple people in the video image to be detected. Finally, the coordinate file with body key points marked on the detected target on the original image is output.(29)Lt=ϕF,Lt−1,∀2≤t≤Tp,(30)STP=ρtF,LTP,∀t=TP,(31)St=ρtF,LTP,St−1,∀TP<t≤TP+TC.The key points obtained by this module should be accurate and conform to the normal motion posture extraction, so as to evaluate correctly, as shown in Figure6.Figure 6
Workflow of human posture recognition module.


## 3.2.2. Application of Motion Evaluation Method

As shown in Figure7, the premise of action recognition also needs to deal with things describing action rules. When we describe the action, we can use the joint points of the human body to calculate the joint angle of the human body by finding a cosine angle with known three-point coordinates. Eight joint angles were selected as human movement indexes, as shown in Table 5.Figure 7
Action description rule workflow.Table 5
Selection of joint angle.
Joint angle numberJoint point1Head, neck, left shoulder2Left shoulder, left elbow, left wrist3Right shoulder, right elbow, right wrist4Left elbow, left shoulder, left hip5Right elbow, right shoulder, right hip6Left knee, neck, right knee7Left hip, left knee, left foot8Right hip, right knee, right foot


## 3.3. Design and Implementation of the System

### 3.3.1. System Development Platform

It is shown in Table6.Table 6
Main configuration.
Hardware platformSoftware platformCPU: Intel (R) core (TM) i5-8300H 2.30 GHz; GPU: NVIDIA GeForce GTX1050Ti 4G; disk: Samsung MZVLB256HAHQ 237G; memory: Samsung DDR4 2666 MHz 8 GBThe software platform is mainly built in visual studio 2015 environment. Open-source computer vision library OpenCV, Microsoft MFC interface library, CUDA architecture, and GPU acceleration library cuDNN are used. The system uses C++ for development, using C++ file operation classes of stream, if stream involved in the program files, data types, text flow, and other objects for processing.


### 3.3.2. Overall Design of the System

The General Design of Motion Attitude Recognition Process. As shown in Figure 8, two databases are created during the recognition of motion posture. These two databases are very important, one of which can capture human motion; the other is a database of processed human motion characteristics. Every step is fully considered in the whole process design, whether it is the interception and capture of video images or the feature matching of data and so on. Through our process, we can give more accurate recognition results in detail.Figure 8
Flow chart of automatic motion attitude recognition.Design of the Aided Evaluation System for Motion. As shown in Figure 9, before logging in, you must register your identity to ensure security and privacy. During the whole operation process, the system will automatically save all the data every 5 min with the increase of time and store them in the information center of the user. If the user stops using it, the system will immediately save all the test-related information. After more than 20 min, the system automatically shuts down. After the system is shut down, if the user needs to use it, he must reopen the interface, open his own data repository, and reopen the interface.Figure 9
Overall function of the system.The Personal Information Module Has Special Password Management. Standard action database provides the most powerful support for the database system, and the application of data needs this module to participate. Here, it will open the picture to be processed for posture feature extraction and find the joint angle of the detected target as an evaluation reference. Of course, this part will also provide the function of adding actions and deleting actions.As its name implies, the auxiliary teaching module provides users with an opportunity to practice. After getting the joint angle, users can compare the similarity between the actions in the database and the actions in the database and, finally, output the final detection results.All the functions of the overall evaluation module are offline, and users can use the functions without hindrance without a network.


## 3.3.1. System Development Platform

It is shown in Table6.Table 6
Main configuration.
Hardware platformSoftware platformCPU: Intel (R) core (TM) i5-8300H 2.30 GHz; GPU: NVIDIA GeForce GTX1050Ti 4G; disk: Samsung MZVLB256HAHQ 237G; memory: Samsung DDR4 2666 MHz 8 GBThe software platform is mainly built in visual studio 2015 environment. Open-source computer vision library OpenCV, Microsoft MFC interface library, CUDA architecture, and GPU acceleration library cuDNN are used. The system uses C++ for development, using C++ file operation classes of stream, if stream involved in the program files, data types, text flow, and other objects for processing.


## 3.3.2. Overall Design of the System

The General Design of Motion Attitude Recognition Process. As shown in Figure 8, two databases are created during the recognition of motion posture. These two databases are very important, one of which can capture human motion; the other is a database of processed human motion characteristics. Every step is fully considered in the whole process design, whether it is the interception and capture of video images or the feature matching of data and so on. Through our process, we can give more accurate recognition results in detail.Figure 8
Flow chart of automatic motion attitude recognition.Design of the Aided Evaluation System for Motion. As shown in Figure 9, before logging in, you must register your identity to ensure security and privacy. During the whole operation process, the system will automatically save all the data every 5 min with the increase of time and store them in the information center of the user. If the user stops using it, the system will immediately save all the test-related information. After more than 20 min, the system automatically shuts down. After the system is shut down, if the user needs to use it, he must reopen the interface, open his own data repository, and reopen the interface.Figure 9
Overall function of the system.The Personal Information Module Has Special Password Management. Standard action database provides the most powerful support for the database system, and the application of data needs this module to participate. Here, it will open the picture to be processed for posture feature extraction and find the joint angle of the detected target as an evaluation reference. Of course, this part will also provide the function of adding actions and deleting actions.As its name implies, the auxiliary teaching module provides users with an opportunity to practice. After getting the joint angle, users can compare the similarity between the actions in the database and the actions in the database and, finally, output the final detection results.All the functions of the overall evaluation module are offline, and users can use the functions without hindrance without a network.


## 4. Experimental Analysis

### 4.1. OpenPose Attitude Recognition Effect

The configuration environment is shown in Table7.Table 7
OpenPose configuration environment.
TypeParameterHardware environmentOperating systemWindows 10 Home EditionCPUIntel® core I5–8300HGraphics cardNvidia GTX1050TiMemorySamsung 8 GBSoftware environmentIntegrated development environmentVisual studio 2015, cmakeAcceleration libraryCUDA 8.0, CUDNN 5.5The key nodes of the human skeleton model are identified as shown in Figure10.Figure 10
Human skeleton model diagram.As shown in Figure11, we invited a volunteer participant as our pretester.Figure 11
Joint point coordinates.The joint point coordinate data are collated as shown in Figure12. The joint coordinates are obtained to calculate the joint angle. By getting the joint angle, we can accurately determine the key points of our human posture. Because the participant’s right foot is blocked, the joint coordinates of the action are missing “right foot,” which is the shortcoming of the system designed in this paper.Figure 12
Joint point coordinates.


### 4.2. Action Evaluation Pretest

We invited three volunteers to pretest the same action, as shown in Figure13.Figure 13
The same action model diagram of three participants.The comparison is shown in Figure14.Figure 14
Comparison of joint angle data of three participants.Everyone’s force point and posture are different. Although all three participants made the action of lifting dumbbells horizontally, the women’s hands in the middle picture are basically parallel to the ground, and the two men’s arms in the left and right pictures are inclined to the ground in different degrees, but their postures are generally the same. According to the joint angle number corresponding to the joint in Table5, we can know whether their motion amplitude meets the standard data.


### 4.3. Test of Sports Action Auxiliary Evaluation System

#### 4.3.1. Overall Evaluation of the System

The overall system interface is shown in Figure15.Figure 15
System interface.The basic toolbar has basic functions, such as file import and export, editing class operations, view selection, and seeking help. The function module is mainly to realize the core functions of the main design of the four systems. The center of the system interface is a large area, which is mainly the video image processing area. We can intuitively observe the whole process. Below this area, there are four functions for processing: action selection, start detection, pause processing, and stop processing. The rightmost column is about the horizontal and vertical coordinates of the key points of the human body detected and processed by us and the corresponding current confidence level.A database is established (i.e., the standard action database mentioned above), and we collect up to 200 motion video sequences (evenly distributed into 15 categories) for auxiliary comparison reference of motion actions. As shown in Figure16, we (partially) intercepted the joint angle data of 5 standard movements in the database for display.Figure 16
(Standard) joint angle data.If two different people are doing the same action, if you want to know who is doing it more standard, you need to use a method to find the “distance” between the two actions: minimum Euclidean distance, that is, the similarity measure between two actions. The formula related to Euclidean distance is as follows:(32)dx,y=∑i=1nxi−yi21/2.As shown in Figure17, we invited a volunteer participant to record the video. We select a video action frame similar to standard actions 1 and 2 for joint angle data display. We can know that the number of action frames A most similar to standard action 1 is 4, and the Euclidean distance from standard action 1 is 5.09902; the number of action frames B most similar to standard action 2 is 7, and the Euclidean distance from standard action 2 is 4.79583. The best action of this participant is the action with the smallest Euclidean distance, that is, the action with Euclidean distance of 4.79583.Figure 17
Joint angle data similar to standard actions 1 and 2.If the participant wants to perfect and standardize his movements, he needs to use the auxiliary teaching function given by this system to practice frequently, approach the standard joint angle data as much as possible, and reduce the Euclidean distance between his movements and the standard movements.


#### 4.3.2. Experimental Result Data

We conducted an action-assisted evaluation on seven kinds of sports videos. The video is set up as shown in Table8.Table 8
Experimental test video settings.
Video nameFormatFrame numberStorage space (MB)Walk1,280 × 720300644Swimming1,280 × 720900592Running1,920 × 1,080600411Sit-ups1,920 × 1,080504508Pull-up1,280 × 720600555Basketball1,920 × 1,080600623Skipping rope1,920 × 1,080500517Of course, in order to better explain the superiority of our system experimental results, we choose to make a comparison with the recognition method based on BP neural network and the traditional recognition method, as shown in Figure18.Figure 18
Experimental comparison results of correct identification quantity.We can see from Figure18 that the traditional method is extremely inefficient, in which the error rate of sit-ups can be as high as 6.8%, and the recognized results are too different from the real results. The recognition method based on BP neural network has obviously improved, and its correct recognition rate can be as high as 96.4%, which is very close to the real result. The correct recognition rate of this method can be as high as 98.7%, which is 2.3% higher than that of the recognition method based on BP neural network. Therefore, this method is the most superior recognition method, and there is room for further optimization in the follow-up work.


## 4.1. OpenPose Attitude Recognition Effect

The configuration environment is shown in Table7.Table 7
OpenPose configuration environment.
TypeParameterHardware environmentOperating systemWindows 10 Home EditionCPUIntel® core I5–8300HGraphics cardNvidia GTX1050TiMemorySamsung 8 GBSoftware environmentIntegrated development environmentVisual studio 2015, cmakeAcceleration libraryCUDA 8.0, CUDNN 5.5The key nodes of the human skeleton model are identified as shown in Figure10.Figure 10
Human skeleton model diagram.As shown in Figure11, we invited a volunteer participant as our pretester.Figure 11
Joint point coordinates.The joint point coordinate data are collated as shown in Figure12. The joint coordinates are obtained to calculate the joint angle. By getting the joint angle, we can accurately determine the key points of our human posture. Because the participant’s right foot is blocked, the joint coordinates of the action are missing “right foot,” which is the shortcoming of the system designed in this paper.Figure 12
Joint point coordinates.


## 4.2. Action Evaluation Pretest

We invited three volunteers to pretest the same action, as shown in Figure13.Figure 13
The same action model diagram of three participants.The comparison is shown in Figure14.Figure 14
Comparison of joint angle data of three participants.Everyone’s force point and posture are different. Although all three participants made the action of lifting dumbbells horizontally, the women’s hands in the middle picture are basically parallel to the ground, and the two men’s arms in the left and right pictures are inclined to the ground in different degrees, but their postures are generally the same. According to the joint angle number corresponding to the joint in Table5, we can know whether their motion amplitude meets the standard data.


## 4.3. Test of Sports Action Auxiliary Evaluation System

### 4.3.1. Overall Evaluation of the System

The overall system interface is shown in Figure15.Figure 15
System interface.The basic toolbar has basic functions, such as file import and export, editing class operations, view selection, and seeking help. The function module is mainly to realize the core functions of the main design of the four systems. The center of the system interface is a large area, which is mainly the video image processing area. We can intuitively observe the whole process. Below this area, there are four functions for processing: action selection, start detection, pause processing, and stop processing. The rightmost column is about the horizontal and vertical coordinates of the key points of the human body detected and processed by us and the corresponding current confidence level.A database is established (i.e., the standard action database mentioned above), and we collect up to 200 motion video sequences (evenly distributed into 15 categories) for auxiliary comparison reference of motion actions. As shown in Figure16, we (partially) intercepted the joint angle data of 5 standard movements in the database for display.Figure 16
(Standard) joint angle data.If two different people are doing the same action, if you want to know who is doing it more standard, you need to use a method to find the “distance” between the two actions: minimum Euclidean distance, that is, the similarity measure between two actions. The formula related to Euclidean distance is as follows:(32)dx,y=∑i=1nxi−yi21/2.As shown in Figure17, we invited a volunteer participant to record the video. We select a video action frame similar to standard actions 1 and 2 for joint angle data display. We can know that the number of action frames A most similar to standard action 1 is 4, and the Euclidean distance from standard action 1 is 5.09902; the number of action frames B most similar to standard action 2 is 7, and the Euclidean distance from standard action 2 is 4.79583. The best action of this participant is the action with the smallest Euclidean distance, that is, the action with Euclidean distance of 4.79583.Figure 17
Joint angle data similar to standard actions 1 and 2.If the participant wants to perfect and standardize his movements, he needs to use the auxiliary teaching function given by this system to practice frequently, approach the standard joint angle data as much as possible, and reduce the Euclidean distance between his movements and the standard movements.


### 4.3.2. Experimental Result Data

We conducted an action-assisted evaluation on seven kinds of sports videos. The video is set up as shown in Table8.Table 8
Experimental test video settings.
Video nameFormatFrame numberStorage space (MB)Walk1,280 × 720300644Swimming1,280 × 720900592Running1,920 × 1,080600411Sit-ups1,920 × 1,080504508Pull-up1,280 × 720600555Basketball1,920 × 1,080600623Skipping rope1,920 × 1,080500517Of course, in order to better explain the superiority of our system experimental results, we choose to make a comparison with the recognition method based on BP neural network and the traditional recognition method, as shown in Figure18.Figure 18
Experimental comparison results of correct identification quantity.We can see from Figure18 that the traditional method is extremely inefficient, in which the error rate of sit-ups can be as high as 6.8%, and the recognized results are too different from the real results. The recognition method based on BP neural network has obviously improved, and its correct recognition rate can be as high as 96.4%, which is very close to the real result. The correct recognition rate of this method can be as high as 98.7%, which is 2.3% higher than that of the recognition method based on BP neural network. Therefore, this method is the most superior recognition method, and there is room for further optimization in the follow-up work.


## 4.3.1. Overall Evaluation of the System

The overall system interface is shown in Figure15.Figure 15
System interface.The basic toolbar has basic functions, such as file import and export, editing class operations, view selection, and seeking help. The function module is mainly to realize the core functions of the main design of the four systems. The center of the system interface is a large area, which is mainly the video image processing area. We can intuitively observe the whole process. Below this area, there are four functions for processing: action selection, start detection, pause processing, and stop processing. The rightmost column is about the horizontal and vertical coordinates of the key points of the human body detected and processed by us and the corresponding current confidence level.A database is established (i.e., the standard action database mentioned above), and we collect up to 200 motion video sequences (evenly distributed into 15 categories) for auxiliary comparison reference of motion actions. As shown in Figure16, we (partially) intercepted the joint angle data of 5 standard movements in the database for display.Figure 16
(Standard) joint angle data.If two different people are doing the same action, if you want to know who is doing it more standard, you need to use a method to find the “distance” between the two actions: minimum Euclidean distance, that is, the similarity measure between two actions. The formula related to Euclidean distance is as follows:(32)dx,y=∑i=1nxi−yi21/2.As shown in Figure17, we invited a volunteer participant to record the video. We select a video action frame similar to standard actions 1 and 2 for joint angle data display. We can know that the number of action frames A most similar to standard action 1 is 4, and the Euclidean distance from standard action 1 is 5.09902; the number of action frames B most similar to standard action 2 is 7, and the Euclidean distance from standard action 2 is 4.79583. The best action of this participant is the action with the smallest Euclidean distance, that is, the action with Euclidean distance of 4.79583.Figure 17
Joint angle data similar to standard actions 1 and 2.If the participant wants to perfect and standardize his movements, he needs to use the auxiliary teaching function given by this system to practice frequently, approach the standard joint angle data as much as possible, and reduce the Euclidean distance between his movements and the standard movements.


## 4.3.2. Experimental Result Data

We conducted an action-assisted evaluation on seven kinds of sports videos. The video is set up as shown in Table8.Table 8
Experimental test video settings.
Video nameFormatFrame numberStorage space (MB)Walk1,280 × 720300644Swimming1,280 × 720900592Running1,920 × 1,080600411Sit-ups1,920 × 1,080504508Pull-up1,280 × 720600555Basketball1,920 × 1,080600623Skipping rope1,920 × 1,080500517Of course, in order to better explain the superiority of our system experimental results, we choose to make a comparison with the recognition method based on BP neural network and the traditional recognition method, as shown in Figure18.Figure 18
Experimental comparison results of correct identification quantity.We can see from Figure18 that the traditional method is extremely inefficient, in which the error rate of sit-ups can be as high as 6.8%, and the recognized results are too different from the real results. The recognition method based on BP neural network has obviously improved, and its correct recognition rate can be as high as 96.4%, which is very close to the real result. The correct recognition rate of this method can be as high as 98.7%, which is 2.3% higher than that of the recognition method based on BP neural network. Therefore, this method is the most superior recognition method, and there is room for further optimization in the follow-up work.


## 5. Conclusion

This paper combines computer technology with sports direction, obtains very ideal data results, verifies the feasibility of this system, makes sports glow with new vitality, and takes a big step forward to intelligence.The results show that(1)
The joint angle data can be obtained from joint coordinates, and the key points of human posture can be calculated for easy analysis.(2)
Motion evaluation criteria is used to measure the video human posture, so as to judge the detection.(3)
According to the standard motion database created in this paper, a formal motion auxiliary evaluation system is established; compared with the standard action, the smaller the Euclidean distance is, the more standard it is. The action with an Euclidean distance of 4.79583 is the best action of the tested person.(4)
Efficiency and inefficiency of traditional methods: the correct recognition rate based on BP neural network method is 96.4%. The correct recognition rate of the attitude recognition method based on this paper can be as high as 98.7%, which is 2.3% higher than the previous method; therefore, the method in this paper has great advantages and the system research results are satisfactory.In this paper, due to technical limitations, we need to further study the fine optimization. It is still in the initial stage, and a large number of deep problems need to be studied. In the recognition process, the problems such as small target, ambiguity, and occlusion will affect the final result, so the automatic recognition rate of attitude motion can further expand the rising space.



---

*Source: 8388325-2022-03-09.xml*